-- Logs begin at Fri 2022-09-30 08:51:32 UTC, end at Fri 2022-09-30 10:08:23 UTC. -- Sep 30 09:37:16.142567 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@q-agt.service. Sep 30 09:37:18.688408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.common.config [-] Logging enabled! Sep 30 09:37:18.689016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.common.config [-] /usr/local/bin/neutron-openvswitch-agent version 21.1.0.dev30 Sep 30 09:37:18.689228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-openvswitch-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=114230) setup_logging /opt/stack/neutron/neutron/common/config.py:123}} Sep 30 09:37:18.689667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO os_ken.base.app_manager [-] loading app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp Sep 30 09:37:19.264517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO keyring.backend [-] Loading KWallet Sep 30 09:37:19.273437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO keyring.backend [-] Loading SecretService Sep 30 09:37:19.276706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO keyring.backend [-] Loading Windows Sep 30 09:37:19.278139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO keyring.backend [-] Loading chainer Sep 30 09:37:19.278853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO keyring.backend [-] Loading macOS Sep 30 09:37:19.883119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.883750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.883750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.884965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.885408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.885838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.946828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.947386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.947829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.957897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.958184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.958450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.981459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.981938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:19.982354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:20.017831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:20.018123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:20.018437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:20.208295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO os_ken.base.app_manager [-] loading app os_ken.app.ofctl.service Sep 30 09:37:20.209284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO os_ken.base.app_manager [-] loading app os_ken.controller.ofp_handler Sep 30 09:37:20.210832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO os_ken.base.app_manager [-] instantiating app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_oskenapp of OVSNeutronAgentOSKenApp Sep 30 09:37:20.211296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO os_ken.base.app_manager [-] instantiating app os_ken.app.ofctl.service of OfctlService Sep 30 09:37:20.211726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO os_ken.base.app_manager [-] instantiating app os_ken.controller.ofp_handler of OFPHandler Sep 30 09:37:20.212968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: Open vSwitch agent after_init 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:20.215296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.agent_extensions_manager [-] Loaded agent extensions: [] Sep 30 09:37:20.215592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 30 09:37:20.215793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Configuration options gathered from: {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 30 09:37:20.216002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 30 09:37:20.216286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 30 09:37:20.216938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ================================================================================ {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 30 09:37:20.216938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent_down_time = 75 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.217116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] allow_bulk = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.217290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_extensions_path = {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.217485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] api_paste_config = api-paste.ini {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.218614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] auth_strategy = keystone {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.218614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] backlog = 4096 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.218614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] base_mac = fa:16:3e:00:00:00 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.218614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_host = 0.0.0.0 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.218896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] bind_port = 9696 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.218970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] client_socket_timeout = 900 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.219181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_dir = [] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.219371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.219614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] config_source = [] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.219861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] control_exchange = neutron {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.222667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] core_plugin = ml2 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.222667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] debug = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.222667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_availability_zones = [] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.222667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.222667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_agent_notification = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.223038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_lease_duration = 86400 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.223038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dhcp_load_type = networks {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.223038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] dns_domain = openstacklocal {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.223038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_new_agents = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.223038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] enable_traditional_dhcp = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.223038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] external_dns_driver = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.223413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] filter_validation = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.223413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] global_physnet_mtu = 1500 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.223754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] host = dv-cinder-master-3-iscsi {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.223948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] http_retries = 3 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.224200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_format = [instance: %(uuid)s] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.224449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.224699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipam_driver = internal {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.224934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ipv6_pd_enabled = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.225174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_config_append = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.225422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.226224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_dir = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.226452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_file = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.226715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval = 1 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.228698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotate_interval_type = days {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.228698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] log_rotation_type = none {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.228698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.228698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.228698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.228698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.229090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.229090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_dns_nameservers = 5 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.229090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_header_line = 16384 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.229090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_count = 30 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.229331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_logfile_size_mb = 200 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.229395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] max_subnet_host_routes = 20 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.229650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] network_link_prefix = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.229814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_data_changes = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.234206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] notify_nova_on_port_status_changes = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.234206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] pagination_max_limit = -1 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.234206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] publish_errors = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.234206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_burst = 0 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.234206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_except_level = CRITICAL {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.234206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rate_limit_interval = 0 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.234206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] retry_until_window = 30 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.235211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_resources_processing_step = 20 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.235211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] rpc_response_max_timeout = 600 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.235211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] send_events_interval = 2 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.235211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.235211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] setproctitle = on {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.235211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] state_path = /opt/stack/data/neutron {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.235211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] syslog_log_facility = LOG_USER {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.236215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] tcp_keepidle = 600 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.236215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] transport_url = **** {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.236215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_eventlog = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.236215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_journal = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.236215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_json = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.236215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_ssl = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.236215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_stderr = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.237197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] use_syslog = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.237197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] vlan_transparent = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.237197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] watch_log_file = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.237197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_default_pool_size = 100 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.237197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_keep_alive = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.237197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.237197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] wsgi_server_debug = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 09:37:20.238202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.disable_process_locking = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.238202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.238202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.connection_string = messaging:// {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.238202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.enabled = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.238202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_doc_type = notification {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.238202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_size = 10000 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.238202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.es_scroll_time = 2m {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.239166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.filter_error_trace = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.239166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.hmac_keys = SECRET_KEY {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.239166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.sentinel_service_name = mymaster {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.239166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.socket_timeout = 0.1 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.239166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] profiler.trace_sqlalchemy = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.239814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_new_defaults = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.239814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.enforce_scope = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.239814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_default_rule = default {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.240203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.240203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.240474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.240685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.241124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.241502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.241889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.242267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.242665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.243050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.243435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.243806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.244215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.244599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.arp_responder = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.244969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.baremetal_smartnic = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.245338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dont_fragment = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.245707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.drop_flows_on_start = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.246093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.246475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.dscp_inherit = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.246879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.enable_distributed_routing = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.247281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.explicitly_egress_direct = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.247669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.l2_population = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.248055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.log_agent_heartbeats = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.248453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.minimize_polling = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.248840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.ovsdb_monitor_respawn_interval = 30 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.249222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.polling_interval = 2 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.249606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.quitting_rpc_timeout = 10 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.249999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.report_interval = 30.0 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.250410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.250839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.251227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_csum = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.251626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.tunnel_types = [] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.252028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.use_helper_for_ns_read = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.252417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.veth_mtu = 9000 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.252818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] AGENT.vxlan_udp_port = 4789 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.253218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mac_table_size = 50000 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.253629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.bridge_mappings = ['physnet1:br-data'] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.254029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.datapath_type = system {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.254425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.igmp_snooping_enable = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.254860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.int_peer_patch_port = patch-tun {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.255264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.integration_bridge = br-int {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.255652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.local_ip = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.256045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_connect_timeout = 300 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.256723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_inactivity_probe = 10 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.257145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_address = 127.0.0.1 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.257554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_listen_port = 6633 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.257943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.of_request_timeout = 300 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.258329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.openflow_processed_per_port = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.258753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_connection = tcp:127.0.0.1:6640 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.259141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_debug = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.259542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ovsdb_timeout = 10 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.259937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_bandwidths = [] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.260318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_default_hypervisor = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.260725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_hypervisors = {} {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.261166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.261606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_inventory_defaults = {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0} {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.262003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_with_direction = [] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.262397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.resource_provider_packet_processing_without_direction = [] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.262826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_ca_cert_file = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.263223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_cert_file = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.263620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.ssl_key_file = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.264039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tun_peer_patch_port = patch-int {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.264440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.tunnel_bridge = br-tun {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.264844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] OVS.vhostuser_socket_dir = /var/run/openvswitch {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.265241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_rebinding_time = 0 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.265628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.dhcp_renewal_time = 0 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.266037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] DHCP.enable_ipv6 = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.266428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] LOCAL_IP.static_nat = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.266845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_section = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.267266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.auth_type = password {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.267667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.268051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.certfile = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.268450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.collect_timing = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.268857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.endpoint_type = public {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.269244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.insecure = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.269626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.keyfile = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.270023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.region_name = RegionOne {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.270426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.split_loggers = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.270843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] nova.timeout = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.271229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_section = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.271629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.auth_type = password {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.272042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.272966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.certfile = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.273371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.collect_timing = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.273771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.endpoint_type = public {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.274156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.insecure = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.274549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.keyfile = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.274959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.region_name = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.275361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.split_loggers = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.275741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] placement.timeout = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.276135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_section = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.276536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.auth_type = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.276915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.cafile = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.277297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.certfile = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.277696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.collect_timing = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.278077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retries = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.278460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.connect_retry_delay = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.278878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.enable_notifications = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.279258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.endpoint_override = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.279666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.insecure = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.280049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.interface = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.280428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.keyfile = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.280808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.max_version = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.281187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.min_version = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.281573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.region_name = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.281971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_name = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.283127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.service_type = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.283522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.split_loggers = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.283909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retries = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.284295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.status_code_retry_delay = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.284678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.timeout = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.285079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.valid_interfaces = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.285465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ironic.version = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.285869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] cli_script.dry_run = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.286289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.286727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.287121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.287530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.287918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.288860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.289267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.289665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.290066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.290461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.290900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.291294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.291692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.292081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.292486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.292892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.293289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.293675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.294059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.294533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.294954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.295346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.295734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.296341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.296763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.297220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.297629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.298035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.298423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.298865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.299288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_rabbit.ssl_version = {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.299693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.driver = [] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.300081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.retry = -1 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.300504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.300904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_messaging_notifications.transport_url = **** {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.301483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.301874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.group = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.302338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.helper_command = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.302768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.logger_name = oslo_privsep.daemon {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.303158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.thread_pool_size = 4 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.303540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep.user = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.303985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.304379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.group = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.304768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.helper_command = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.305163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.305558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.305948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_dhcp_release.user = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.306345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.306767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.group = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.307146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.helper_command = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.307555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.307951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.308349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_ovs_vsctl.user = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.308745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.capabilities = [21] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.309128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.group = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.309510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.helper_command = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.309903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.310302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.thread_pool_size = 4 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.310723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_namespace.user = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.311118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.capabilities = [12] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.311514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.group = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.311894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.helper_command = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.312288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.312686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.thread_pool_size = 4 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.313076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_conntrack.user = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.313473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.capabilities = [12, 21] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.313855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.group = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.314237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.helper_command = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.314669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.315071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.thread_pool_size = 4 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.315464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] privsep_link.user = None {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.315859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] service_providers.service_provider = [] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.316251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.316593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] agent.extensions = [] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.316999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.default_quota = -1 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.317403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.317809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_network = 100 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.318226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_port = 500 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.318670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_rbac_policy = 10 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.319089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group = 100 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.320020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_security_group_rule = 100 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.320422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.quota_subnet = 100 {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.320811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] QUOTAS.track_quota_usage = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.321207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_ipset = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.321608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.enable_security_group = True {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.322025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.322420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 09:37:20.322790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] ******************************************************************************** {{(pid=114230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 30 09:37:20.374307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Flow_Table.name {{(pid=114230) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Sep 30 09:37:20.374837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Mirror.name {{(pid=114230) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:85}} Sep 30 09:37:20.375264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Bridge.name {{(pid=114230) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 30 09:37:20.375643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port.name {{(pid=114230) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 30 09:37:20.375995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Interface.name {{(pid=114230) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 30 09:37:20.376333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Manager.target {{(pid=114230) autocreate_indices /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:104}} Sep 30 09:37:20.442788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-int, may_exist=True, datapath_type=system) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:20.443366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow10', 'OpenFlow14', 'OpenFlow13')) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:20.445073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:20.452301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-int, mode=secure) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:20.460540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-int. {{(pid=114230) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:80}} Sep 30 09:37:20.461363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-int, targets=['tcp:127.0.0.1:6633']) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:21.469312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=8f39692e-8c2e-41cd-9903-f8ac8f83e06e, col_values=(('connection_mode', 'out-of-band'),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:21.477756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=8f39692e-8c2e-41cd-9903-f8ac8f83e06e, col_values=(('inactivity_probe', 10000),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:21.483062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Bridge, record=br-int, col_values=(('mcast_snooping_enable', False),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:21.484243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Bridge, record=br-int, col_values=(('other_config', {'mcast-snooping-disable-flood-unregistered': 'false'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:21.495106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-int has datapath-ID 0000d6e029c3754e Sep 30 09:37:21.501593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0x32836155,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=23) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:21.504379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x32836157,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:21.508985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x32836159,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=59) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:21.512364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0x3283615b,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=60) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:21.516736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x38,xid=0x3283615d,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=24) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:21.519262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x3283615f,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'vlan_vid': 8191}),out_group=0,out_port=0,priority=65535,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:21.522932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0x32836161,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=3,table_id=62) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:21.526184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x32836163,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=30) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:21.528657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x32836165,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=31) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:21.529235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.utils [-] Std library socket module is patched by eventlet. Requesting std library socket module from eventlet. {{(pid=114230) __init__ /opt/stack/neutron/neutron/agent/common/utils.py:91}} Sep 30 09:37:21.530058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Mapping physical network physnet1 to bridge br-data Sep 30 09:37:21.531633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [-] Bridge br-data datapath-id = 0x000016fb74bd4845 Sep 30 09:37:21.532537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(name=br-data, may_exist=True, datapath_type=system) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:21.534371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbAddCommand(table=Bridge, record=br-data, column=protocols, values=('OpenFlow10', 'OpenFlow14', 'OpenFlow13')) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:21.535058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(table=Bridge, record=br-data, col_values=(('other_config', {'mac-table-size': '50000'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:21.544933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetFailModeCommand(bridge=br-data, mode=secure) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:21.555737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Setting controller tcp:127.0.0.1:6633 for bridge br-data. {{(pid=114230) setup_controllers /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_bridge.py:80}} Sep 30 09:37:21.556556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): SetControllerCommand(bridge=br-data, targets=['tcp:127.0.0.1:6633']) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:22.567271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=a197881d-26db-43ff-abbb-8eecd55547d0, col_values=(('connection_mode', 'out-of-band'),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:22.583952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Controller, record=a197881d-26db-43ff-abbb-8eecd55547d0, col_values=(('inactivity_probe', 10000),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:22.588138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_bridge [-] Bridge br-data has datapath-ID 000016fb74bd4845 Sep 30 09:37:22.591488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x50,xid=0xc9105ed8,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],match=OFPMatch(oxm_fields={}),out_group=0,out_port=0,priority=0,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:22.592631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-int, port=int-br-data, may_exist=True) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:22.593467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=int-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:22.604741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=int-br-data, col_values=(('other_config', {'mcast-snooping-flood-reports': 'False', 'mcast-snooping-flood': 'False'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:22.611776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(bridge=br-data, port=phy-br-data, may_exist=True) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:22.612705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('type', 'patch'), ('options', {'peer': 'nonexistent-peer'}))) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:22.625855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0x32836167,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:22.628226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [-] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xc9105eda,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:22.629059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=int-br-data, col_values=(('options', {'peer': 'phy-br-data'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:22.638045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Interface, record=phy-br-data, col_values=(('options', {'peer': 'int-br-data'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:22.659999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Port {{(pid=114230) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 30 09:37:22.670815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroup {{(pid=114230) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 30 09:37:22.671956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for SecurityGroupRule {{(pid=114230) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 30 09:37:22.672960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Network {{(pid=114230) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 30 09:37:22.674885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for Subnet {{(pid=114230) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 30 09:37:22.676500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.callbacks.resource_manager [-] Registering callback for AddressGroup {{(pid=114230) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 30 09:37:22.897772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_update 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:22.898800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_update 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:22.899214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Port after_delete 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:22.899612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > Network after_delete 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:22.900017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_delete 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:22.900451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > SecurityGroup after_update 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:22.984295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Init firewall settings (driver=openvswitch) {{(pid=114230) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:121}} Sep 30 09:37:22.985897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbAddCommand(table=Bridge, record=br-int, column=protocols, values=('OpenFlow12', 'OpenFlow11')) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:24.003835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-3553b2c4-a215-4526-b771-8c565331667e None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c011c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:24.007361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-3553b2c4-a215-4526-b771-8c565331667e None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c011e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:24.009762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-3553b2c4-a215-4526-b771-8c565331667e None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0120,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:24.012281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-3553b2c4-a215-4526-b771-8c565331667e None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0122,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:24.014620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-3553b2c4-a215-4526-b771-8c565331667e None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0124,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:24.015580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.ip_conntrack [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Starting ip_conntrack _process_queue_worker() threads {{(pid=114230) _start_process_queue /opt/stack/neutron/neutron/agent/linux/ip_conntrack.py:80}} Sep 30 09:37:24.016578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Processing 1 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:37:24.018292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO oslo.privsep.daemon [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.default', '--privsep_sock_path', '/tmp/tmpdpaa_pr5/privsep.sock'] Sep 30 09:37:24.033682 dv-cinder-master-3-iscsi sudo[115953]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.default --privsep_sock_path /tmp/tmpdpaa_pr5/privsep.sock Sep 30 09:37:24.035309 dv-cinder-master-3-iscsi sudo[115953]: pam_unix(sudo:session): session opened for user root by (uid=0) Sep 30 09:37:25.396378 dv-cinder-master-3-iscsi sudo[115953]: pam_unix(sudo:session): session closed for user root Sep 30 09:37:25.403958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO oslo.privsep.daemon [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Spawned new privsep daemon via rootwrap Sep 30 09:37:25.404462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Accepted privsep connection to /tmp/tmpdpaa_pr5/privsep.sock {{(pid=114230) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Sep 30 09:37:25.405657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 30 09:37:25.405912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 30 09:37:25.406166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_NET_ADMIN|CAP_SYS_ADMIN|CAP_SYS_PTRACE/none Sep 30 09:37:25.406411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 115962 Sep 30 09:37:25.409680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fce1ebd-382e-4664-a4d4-59af3db41c4e]: (2,) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:26.028256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "context-manager" by "neutron_lib.db.api._create_context_manager" {{(pid=115962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 30 09:37:26.028920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" acquired by "neutron_lib.db.api._create_context_manager" :: waited 0.001s {{(pid=115962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 30 09:37:26.029529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo_concurrency.lockutils [-] Lock "context-manager" "released" by "neutron_lib.db.api._create_context_manager" :: held 0.001s {{(pid=115962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 30 09:37:26.273435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9abb329-e2a7-4cd9-af88-8d1132922980]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:26.274348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Processing 1 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:37:26.296467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d067808-0459-431f-8a4c-04b57fd2b533]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:26.297320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Processing 1 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:37:26.320458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f162a6e-ad55-4837-bbff-08e58cc3afa1]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:26.321658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Processing 1 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:37:26.345928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2493e8b0-9e13-40ea-8430-a5e311b2bd27]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:26.347112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Processing 1 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:37:26.377860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c2974c-ab9c-4244-89b5-e6b0882ee46c]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:26.380370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Processing 1 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:37:26.411101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0553402f-9464-41e3-ac68-27a54b5730da]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:26.411101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Processing 1 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:37:26.437421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[86133eb9-4b89-4268-bc5c-1e9a63816e1f]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:26.438062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Processing 1 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:37:26.462112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6163c09-0b32-42d6-89fe-d2f98a57ab54]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:26.463104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Processing 1 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:37:26.496635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e799e1a-48b5-47e5-806b-76e528b4c119]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:26.498662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Processing 1 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:37:26.523983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8023c0bc-14b9-47a1-b804-7869415b78f1]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:26.525121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Subscribe: > agent ovs_restarted 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:26.525239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Subscribe: > SecurityGroupRule after_delete 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:26.525532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Subscribe: > SecurityGroupRule after_update 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:26.525858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Subscribe: > Port after_delete 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:26.526182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Subscribe: > Port after_update 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:26.526522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Subscribe: > AddressGroup after_update 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:26.526924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Subscribe: > AddressGroup after_delete 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:26.608604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.driver.init_handler-8741324605934'] for Open vSwitch agent (None), after_init {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:26.609537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Subscribe: > ovsdb after_read 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:26.610717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Subscribe: > Trunk before_create 55550000 {{(pid=114230) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 30 09:37:26.611345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Registering callback for Trunk {{(pid=114230) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 30 09:37:26.611859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Registering callback for SubPort {{(pid=114230) register /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:62}} Sep 30 09:37:26.670657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.callbacks.resource_manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Unregistering callback for Trunk {{(pid=114230) unregister /opt/stack/neutron/neutron/api/rpc/callbacks/resource_manager.py:72}} Sep 30 09:37:26.671258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent initialized successfully, now running... Sep 30 09:37:26.673597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO oslo.privsep.daemon [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Running privsep helper: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--privsep_context', 'neutron.privileged.ovs_vsctl_cmd', '--privsep_sock_path', '/tmp/tmpoim7x_oq/privsep.sock'] Sep 30 09:37:26.691977 dv-cinder-master-3-iscsi sudo[116013]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf privsep-helper --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --privsep_context neutron.privileged.ovs_vsctl_cmd --privsep_sock_path /tmp/tmpoim7x_oq/privsep.sock Sep 30 09:37:26.693400 dv-cinder-master-3-iscsi sudo[116013]: pam_unix(sudo:session): session opened for user root by (uid=0) Sep 30 09:37:27.942459 dv-cinder-master-3-iscsi sudo[116013]: pam_unix(sudo:session): session closed for user root Sep 30 09:37:27.949644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO oslo.privsep.daemon [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Spawned new privsep daemon via rootwrap Sep 30 09:37:27.950153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Accepted privsep connection to /tmp/tmpoim7x_oq/privsep.sock {{(pid=114230) __init__ /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:362}} Sep 30 09:37:27.951117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 30 09:37:27.951481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 30 09:37:27.951743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 30 09:37:27.951992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 116022 Sep 30 09:37:27.954942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d514d13d-bb81-424a-8058-6a147f1e569b]: (2,) {{(pid=116022) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:28.169417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 {{(pid=116022) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 30 09:37:28.175884 dv-cinder-master-3-iscsi ovs-vsctl[116024]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=10 --id=@manager -- create Manager "target=\"ptcp:6640:127.0.0.1\"" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000 Sep 30 09:37:28.179204 dv-cinder-master-3-iscsi ovs-vsctl[116024]: ovs|00002|db_ctl_base|ERR|multiple rows in Manager match "ptcp:6640:127.0.0.1" Sep 30 09:37:28.180896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo_concurrency.processutils [-] CMD "ovs-vsctl --timeout=10 --id=@manager -- create Manager target="ptcp:6640:127.0.0.1" -- add Open_vSwitch . manager_options @manager -- set Manager ptcp:6640:127.0.0.1 inactivity_probe=10000" returned: 1 in 0.011s {{(pid=116022) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 30 09:37:28.181215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b08b6e-f6a3-4927-9079-fd76ccba8aa4]: (4, ('', 'ovs-vsctl: multiple rows in Manager match "ptcp:6640:127.0.0.1"\n')) {{(pid=116022) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:28.181818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Launching async process [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]. {{(pid=114230) start /opt/stack/neutron/neutron/agent/common/async_process.py:117}} Sep 30 09:37:28.182150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Running command: ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] {{(pid=114230) create_process /opt/stack/neutron/neutron/agent/linux/utils.py:84}} Sep 30 09:37:28.189293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:28.190088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:0 started Sep 30 09:37:28.196174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0126,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=693000000,duration_sec=6,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:28.196174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:28.196174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:0 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:37:28.197413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a11e2efc-7ea2-47d0-a809-f9488368426a","initial","int-br-data",1,["map",[]]],["e2c595e6-a66b-4d62-87b3-4163e61e4cb7","initial","eth1",1,["map",[]]],["3c05fea5-a1c6-4be7-a149-908d4ddcd041","initial","br-data",65534,["map",[]]],["7a9cbce0-7a36-4d79-bbf6-b3365718e9e4","initial","phy-br-data",2,["map",[]]],["27dac59e-8847-4f90-8806-2841a8ec6918","initial","br-int",65534,["map",[]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:37:30.191379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:1 started Sep 30 09:37:30.193851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0128,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=694000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.194415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:30.194954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:1 - starting polling. Elapsed:0.004 Sep 30 09:37:30.196222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:30.197125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:1 - port information retrieved. Elapsed:0.006 Sep 30 09:37:30.197414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Cleaning stale br-int flows Sep 30 09:37:30.198020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Reserved cookies for br-int: {17454195956231332773} Sep 30 09:37:30.200721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c012a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=681000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'vlan_vid': 8191}),packet_count=0,priority=65535,table_id=0), OFPFlowStats(byte_count=1124,cookie=17454195956231332773,duration_nsec=574000000,duration_sec=7,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 1}),packet_count=9,priority=2,table_id=0), OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=696000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=0)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.202573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c012c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.204394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c012e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.206391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0130,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=706000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.208440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0132,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=24,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=691000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=24)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.210265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0134,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=25,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.212119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0136,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=61,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.214227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0138,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=30,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=689000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=30)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.216391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c013a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=31,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=687000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=59,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=31)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.218565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c013c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=59,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=709000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionGotoTable(len=8,table_id=60,type=1)],length=64,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=59)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.221015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c013e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=60,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=709000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=60)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.225614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0140,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=62,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=703000000,duration_sec=8,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=3,table_id=62)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.228624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0142,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=71,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=831000000,duration_sec=3,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionCTClear(experimenter=8992,len=16,subtype=43,type=65535), NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=71,type=65535)],len=40,type=4)],length=104,match=OFPMatch(oxm_fields={'ct_state': (32, 32)}),packet_count=0,priority=110,table_id=71), OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=966000000,duration_sec=3,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=71)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.230746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0144,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=72,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=945000000,duration_sec=3,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=72)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.232775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0146,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=73,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=924000000,duration_sec=3,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=73)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.234667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0148,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=77,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.236483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c014a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=78,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.238489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c014c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=81,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=904000000,duration_sec=3,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=81)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.240525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c014e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=82,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=876000000,duration_sec=3,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=82)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.243551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0150,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=91,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=793000000,duration_sec=3,flags=4,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[NXActionResubmitTable(experimenter=8992,in_port=65528,len=16,subtype=14,table_id=94,type=65535)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=0,priority=1,table_id=91)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.245575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0152,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=92,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=765000000,duration_sec=3,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=92)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.247643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0154,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=93,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=734000000,duration_sec=3,flags=4,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=93)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.247953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Cleaning stale br-data flows Sep 30 09:37:30.248260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Reserved cookies for br-data: {16864421859504038737} Sep 30 09:37:30.250812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xc9105edc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=0,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=16864421859504038737,duration_nsec=622000000,duration_sec=7,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=64,match=OFPMatch(oxm_fields={'in_port': 2}),packet_count=0,priority=2,table_id=0), OFPFlowStats(byte_count=1124,cookie=16864421859504038737,duration_nsec=659000000,duration_sec=7,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=24,type=4)],length=80,match=OFPMatch(oxm_fields={}),packet_count=9,priority=0,table_id=0)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.252652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xc9105ede,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=1,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.254484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xc9105ee0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=2,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.256573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xc9105ee2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=3,type=1) result [OFPFlowStatsReply(body=[],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:30.256900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:1 - cleanup stale flows. Elapsed:0.066 Sep 30 09:37:30.257237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:1 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.066 Sep 30 09:37:32.192090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:2 started Sep 30 09:37:32.195085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0156,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=694000000,duration_sec=10,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:32.195659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:32.196002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:2 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:37:33.103033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: WARNING oslo_policy.policy [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 30 09:37:33.103430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: WARNING oslo_policy.policy [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 30 09:37:33.107357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:37:32Z,description='Default security group',id=26b8b493-5f11-47b5-912b-81bb5a18780f,is_default=True,name='default',project_id='333c93c6a3ef48b6806ea0d5f14ce211',revision_number=1,rules=[SecurityGroupRule(1c5340f2-323e-46f2-98b7-c60b02c8fc63),SecurityGroupRule(2dbe24fa-1624-4456-a10c-93c2dac7872f),SecurityGroupRule(79cd0384-fe95-4c05-84ab-3bd8e57bb2b2),SecurityGroupRule(8d83c5bf-0b61-44a6-bd2b-415b092b2e58)],shared=False,stateful=True,updated_at=2022-09-30T09:37:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:33.107753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (26b8b493-5f11-47b5-912b-81bb5a18780f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:33.108421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:37:32Z,description=,direction='egress',ethertype='IPv4',id=1c5340f2-323e-46f2-98b7-c60b02c8fc63,normalized_cidr=None,port_range_max=,port_range_min=,project_id='333c93c6a3ef48b6806ea0d5f14ce211',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=26b8b493-5f11-47b5-912b-81bb5a18780f,updated_at=2022-09-30T09:37:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:33.108778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (1c5340f2-323e-46f2-98b7-c60b02c8fc63), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:33.109141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Security group rule updated ['26b8b493-5f11-47b5-912b-81bb5a18780f'] Sep 30 09:37:33.109844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:37:32Z,description=,direction='ingress',ethertype='IPv6',id=2dbe24fa-1624-4456-a10c-93c2dac7872f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='333c93c6a3ef48b6806ea0d5f14ce211',protocol=,remote_address_group_id=,remote_group_id=26b8b493-5f11-47b5-912b-81bb5a18780f,remote_ip_prefix=,revision_number=0,security_group_id=26b8b493-5f11-47b5-912b-81bb5a18780f,updated_at=2022-09-30T09:37:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:33.110195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2dbe24fa-1624-4456-a10c-93c2dac7872f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:33.110520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Security group rule updated ['26b8b493-5f11-47b5-912b-81bb5a18780f'] Sep 30 09:37:33.111220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:37:32Z,description=,direction='egress',ethertype='IPv6',id=79cd0384-fe95-4c05-84ab-3bd8e57bb2b2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='333c93c6a3ef48b6806ea0d5f14ce211',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=26b8b493-5f11-47b5-912b-81bb5a18780f,updated_at=2022-09-30T09:37:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:33.111568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (79cd0384-fe95-4c05-84ab-3bd8e57bb2b2), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:33.111889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Security group rule updated ['26b8b493-5f11-47b5-912b-81bb5a18780f'] Sep 30 09:37:33.112546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:37:32Z,description=,direction='ingress',ethertype='IPv4',id=8d83c5bf-0b61-44a6-bd2b-415b092b2e58,normalized_cidr=None,port_range_max=,port_range_min=,project_id='333c93c6a3ef48b6806ea0d5f14ce211',protocol=,remote_address_group_id=,remote_group_id=26b8b493-5f11-47b5-912b-81bb5a18780f,remote_ip_prefix=,revision_number=0,security_group_id=26b8b493-5f11-47b5-912b-81bb5a18780f,updated_at=2022-09-30T09:37:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:33.112894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8d83c5bf-0b61-44a6-bd2b-415b092b2e58), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:33.113217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Security group rule updated ['26b8b493-5f11-47b5-912b-81bb5a18780f'] Sep 30 09:37:33.290373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:37:32Z,description='',dns_domain=None,id=75af3093-2420-45d6-8e8e-061034438cbf,mtu=1500,name='private',project_id='333c93c6a3ef48b6806ea0d5f14ce211',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(75af3093-2420-45d6-8e8e-061034438cbf),segments=[NetworkSegment(6a177cda-71bb-400a-88b7-8166ceec6665)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:37:32Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:33.291134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (75af3093-2420-45d6-8e8e-061034438cbf), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:33.432326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-c5f0e1f5-7087-4dd6-932e-ffbd18cc7a98 demo demo] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 75af3093-2420-45d6-8e8e-061034438cbf with segmentation id not found. Sep 30 09:37:33.432326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:37:33.432326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:37:33.432326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:37:33.432326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:37:33.432326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:37:33.432326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:37:33.432326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:37:33.432326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:37:33.432326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:37:33.432326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:37:33.432326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:37:33.432326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:37:33.433395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:37:33.433395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:37:33.433395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:37:33.433395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 75af3093-2420-45d6-8e8e-061034438cbf with segmentation id not found. Sep 30 09:37:33.433395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:37:34.193295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:3 started Sep 30 09:37:34.196035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0158,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=696000000,duration_sec=12,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:34.196585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:34.196929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:3 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:37:36.194464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:4 started Sep 30 09:37:36.197005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c015a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=697000000,duration_sec=14,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:36.198040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:36.198040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:4 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:37:36.894227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7b5aaf2a-60e8-4d2c-af73-abbe3dbb4a08 demo admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(4d74bea3-63c0-460c-831d-1eedd8bf3ad6)],cidr=172.20.0.0/26,created_at=2022-09-30T09:37:36Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=c4bbdd90-ebba-4442-8512-fdcef6a79e53,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='private-subnet',network_id=75af3093-2420-45d6-8e8e-061034438cbf,project_id='333c93c6a3ef48b6806ea0d5f14ce211',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id='5471f1a3-18db-4147-aaeb-bc98856e7631',updated_at=2022-09-30T09:37:36Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:36.894619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7b5aaf2a-60e8-4d2c-af73-abbe3dbb4a08 demo admin] Publish callbacks [] for Subnet (c4bbdd90-ebba-4442-8512-fdcef6a79e53), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:38.060682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-69b9d786-ba91-4f30-a5bc-49507a8a88d9 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:37:37Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-75af3093-2420-45d6-8e8e-061034438cbf',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=56479e13-743f-48e1-a33c-f8888b22c96a,mac_address=fa:16:3e:5e:45:ad,name='',network_id=75af3093-2420-45d6-8e8e-061034438cbf,numa_affinity_policy=,project_id='333c93c6a3ef48b6806ea0d5f14ce211',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(56479e13-743f-48e1-a33c-f8888b22c96a),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:37:37Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:38.061198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-69b9d786-ba91-4f30-a5bc-49507a8a88d9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (56479e13-743f-48e1-a33c-f8888b22c96a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:38.196480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:5 started Sep 30 09:37:38.199519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c015c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=699000000,duration_sec=16,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:38.200093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:38.200428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:5 - starting polling. Elapsed:0.004 Sep 30 09:37:38.201292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:38.202166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:5 - port information retrieved. Elapsed:0.006 Sep 30 09:37:38.202496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:5 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:37:38.418258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-69b9d786-ba91-4f30-a5bc-49507a8a88d9 None None] Resource Port 56479e13-743f-48e1-a33c-f8888b22c96a updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=56479e13-743f-48e1-a33c-f8888b22c96a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=56479e13-743f-48e1-a33c-f8888b22c96a,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=56479e13-743f-48e1-a33c-f8888b22c96a,segment=NetworkSegment(6a177cda-71bb-400a-88b7-8166ceec6665),segment_id=6a177cda-71bb-400a-88b7-8166ceec6665)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:37:38.418790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-69b9d786-ba91-4f30-a5bc-49507a8a88d9 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (56479e13-743f-48e1-a33c-f8888b22c96a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:40.197719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:6 started Sep 30 09:37:40.200798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c015e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=700000000,duration_sec=18,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:40.201465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:40.201876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:6 - starting polling. Elapsed:0.004 Sep 30 09:37:40.202922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:40.203802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:6 - port information retrieved. Elapsed:0.006 Sep 30 09:37:40.204249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:6 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:37:42.199092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:7 started Sep 30 09:37:42.201656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0160,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=701000000,duration_sec=20,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:42.202250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:42.202638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:7 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:37:44.199650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:8 started Sep 30 09:37:44.202144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0162,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=702000000,duration_sec=22,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:44.202716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:44.203070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:8 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:37:45.074382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b89fe1b6-d5cc-4925-a2dc-43d513bde67f","insert","tap56479e13-74",["set",[]],["map",[["attached-mac","fa:16:3e:5e:45:ad"],["iface-id","56479e13-743f-48e1-a33c-f8888b22c96a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:37:45.089203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["b89fe1b6-d5cc-4925-a2dc-43d513bde67f","old",null,["set",[]],null],["","new","tap56479e13-74",2,["map",[["attached-mac","fa:16:3e:5e:45:ad"],["iface-id","56479e13-743f-48e1-a33c-f8888b22c96a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:37:46.200829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:9 started Sep 30 09:37:46.204002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0164,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=703000000,duration_sec=24,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:46.204586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:46.205043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:9 - starting polling. Elapsed:0.004 Sep 30 09:37:46.206031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:46.206919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:9 - port information retrieved. Elapsed:0.006 Sep 30 09:37:46.207241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'56479e13-743f-48e1-a33c-f8888b22c96a'}, 'added': {'56479e13-743f-48e1-a33c-f8888b22c96a'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:37:46.207830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '56479e13-743f-48e1-a33c-f8888b22c96a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-75af3093-2420-45d6-8e8e-061034438cbf', 'network_id': '75af3093-2420-45d6-8e8e-061034438cbf', 'port_id': '56479e13-743f-48e1-a33c-f8888b22c96a', 'mac_address': 'fa:16:3e:5e:45:ad', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 377, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c4bbdd90-ebba-4442-8512-fdcef6a79e53', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:37:46.208655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 56479e13-743f-48e1-a33c-f8888b22c96a {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:37:46.208996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 56479e13-743f-48e1-a33c-f8888b22c96a updated. Details: {'device': '56479e13-743f-48e1-a33c-f8888b22c96a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-75af3093-2420-45d6-8e8e-061034438cbf', 'network_id': '75af3093-2420-45d6-8e8e-061034438cbf', 'port_id': '56479e13-743f-48e1-a33c-f8888b22c96a', 'mac_address': 'fa:16:3e:5e:45:ad', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 377, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c4bbdd90-ebba-4442-8512-fdcef6a79e53', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:37:46.209342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 1 as local vlan for net-id=75af3093-2420-45d6-8e8e-061034438cbf, seg-id=377 Sep 30 09:37:46.212379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xc9105ee4,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4473), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4097}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:46.214530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xf1c0166,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4097)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4473}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:46.215607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap56479e13-74, col_values=(('tag', 1),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:46.216039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap56479e13-74, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:46.216466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap56479e13-74, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:46.226313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap56479e13-74, col_values=(('other_config', {'net_uuid': '75af3093-2420-45d6-8e8e-061034438cbf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '377'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:46.233964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0168,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:46.234416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:9 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 1 devices currently available. Time elapsed: 0.027 Sep 30 09:37:46.235047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:37:46.235973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'56479e13-743f-48e1-a33c-f8888b22c96a'} Sep 30 09:37:46.237501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:37:46.237851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:37:46.239763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:37:46.288091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae1732c-069e-4075-802b-cb1a6d3ede66]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:46.288710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:9 - agent port security group processed in 0.081 Sep 30 09:37:46.289322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 56479e13-743f-48e1-a33c-f8888b22c96a to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:37:46.790767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['56479e13-743f-48e1-a33c-f8888b22c96a'] and devices down [] completed. Sep 30 09:37:46.791986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:9 - ports processed. Elapsed:0.590 Sep 30 09:37:46.792463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:9 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.592 Sep 30 09:37:46.872147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port 56479e13-743f-48e1-a33c-f8888b22c96a updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:37:46.872624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (56479e13-743f-48e1-a33c-f8888b22c96a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:48.201627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:10 started Sep 30 09:37:48.204074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c016a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=704000000,duration_sec=26,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:48.204636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:48.204975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:10 - starting polling. Elapsed:0.004 Sep 30 09:37:48.205938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:48.206826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:10 - port information retrieved. Elapsed:0.005 Sep 30 09:37:48.207144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'56479e13-743f-48e1-a33c-f8888b22c96a'}, 'added': set(), 'removed': set(), 'updated': {'56479e13-743f-48e1-a33c-f8888b22c96a'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:37:48.207701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '56479e13-743f-48e1-a33c-f8888b22c96a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-75af3093-2420-45d6-8e8e-061034438cbf', 'network_id': '75af3093-2420-45d6-8e8e-061034438cbf', 'port_id': '56479e13-743f-48e1-a33c-f8888b22c96a', 'mac_address': 'fa:16:3e:5e:45:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 377, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c4bbdd90-ebba-4442-8512-fdcef6a79e53', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:37:48.208531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 56479e13-743f-48e1-a33c-f8888b22c96a {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:37:48.208841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 56479e13-743f-48e1-a33c-f8888b22c96a updated. Details: {'device': '56479e13-743f-48e1-a33c-f8888b22c96a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-75af3093-2420-45d6-8e8e-061034438cbf', 'network_id': '75af3093-2420-45d6-8e8e-061034438cbf', 'port_id': '56479e13-743f-48e1-a33c-f8888b22c96a', 'mac_address': 'fa:16:3e:5e:45:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 377, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c4bbdd90-ebba-4442-8512-fdcef6a79e53', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Sep 30 09:37:48.209832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap56479e13-74, col_values=(('tag', 1),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:48.210250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap56479e13-74, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:48.210663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap56479e13-74, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:48.211118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:37:48.211839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap56479e13-74, col_values=(('other_config', {'net_uuid': '75af3093-2420-45d6-8e8e-061034438cbf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '377', 'tag': '1'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:37:48.212511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:37:48.214540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c016c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:48.214893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:10 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 1 devices currently available. Time elapsed: 0.007 Sep 30 09:37:48.215238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:37:48.215525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:37:48.216617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:37:48.216898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:37:48.218455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:37:48.254630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb0172c-2efc-464a-bc91-2fd3d0134c8a]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:37:48.255238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:10 - agent port security group processed in 0.048 Sep 30 09:37:48.256168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 56479e13-743f-48e1-a33c-f8888b22c96a to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:37:48.377980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['56479e13-743f-48e1-a33c-f8888b22c96a'] and devices down [] completed. Sep 30 09:37:48.378369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:10 - ports processed. Elapsed:0.177 Sep 30 09:37:48.378812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:10 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.177 Sep 30 09:37:50.202434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:11 started Sep 30 09:37:50.204879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c016e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=705000000,duration_sec=28,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:50.205461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:50.205805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:11 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:37:52.203484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:12 started Sep 30 09:37:52.205857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0170,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=706000000,duration_sec=30,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:52.206406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:52.206790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:12 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:37:52.606466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:37:52Z,description='Default security group',id=9e5e16bb-f37f-4cff-a1ad-3e43ff03174e,is_default=True,name='default',project_id='f04f50d086c64df3bc18b4c8f8baadc4',revision_number=1,rules=[SecurityGroupRule(2d424c77-ac5b-48c5-b031-40ef365935be),SecurityGroupRule(373bbdc5-c59d-4177-8e56-5b61fa4459e1),SecurityGroupRule(8bca8337-4c6e-413c-a669-f9c22f8cab2b),SecurityGroupRule(c2401bf2-43e6-492c-8b01-5d18a047923c)],shared=False,stateful=True,updated_at=2022-09-30T09:37:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:52.606899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (9e5e16bb-f37f-4cff-a1ad-3e43ff03174e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:52.607510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:37:52Z,description=,direction='egress',ethertype='IPv6',id=2d424c77-ac5b-48c5-b031-40ef365935be,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f04f50d086c64df3bc18b4c8f8baadc4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e5e16bb-f37f-4cff-a1ad-3e43ff03174e,updated_at=2022-09-30T09:37:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:52.607875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2d424c77-ac5b-48c5-b031-40ef365935be), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:52.608212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Security group rule updated ['9e5e16bb-f37f-4cff-a1ad-3e43ff03174e'] Sep 30 09:37:52.608900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:37:52Z,description=,direction='ingress',ethertype='IPv6',id=373bbdc5-c59d-4177-8e56-5b61fa4459e1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f04f50d086c64df3bc18b4c8f8baadc4',protocol=,remote_address_group_id=,remote_group_id=9e5e16bb-f37f-4cff-a1ad-3e43ff03174e,remote_ip_prefix=,revision_number=0,security_group_id=9e5e16bb-f37f-4cff-a1ad-3e43ff03174e,updated_at=2022-09-30T09:37:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:52.609258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (373bbdc5-c59d-4177-8e56-5b61fa4459e1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:52.609585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Security group rule updated ['9e5e16bb-f37f-4cff-a1ad-3e43ff03174e'] Sep 30 09:37:52.610404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:37:52Z,description=,direction='egress',ethertype='IPv4',id=8bca8337-4c6e-413c-a669-f9c22f8cab2b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f04f50d086c64df3bc18b4c8f8baadc4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9e5e16bb-f37f-4cff-a1ad-3e43ff03174e,updated_at=2022-09-30T09:37:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:52.610785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8bca8337-4c6e-413c-a669-f9c22f8cab2b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:52.611116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Security group rule updated ['9e5e16bb-f37f-4cff-a1ad-3e43ff03174e'] Sep 30 09:37:52.611856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:37:52Z,description=,direction='ingress',ethertype='IPv4',id=c2401bf2-43e6-492c-8b01-5d18a047923c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f04f50d086c64df3bc18b4c8f8baadc4',protocol=,remote_address_group_id=,remote_group_id=9e5e16bb-f37f-4cff-a1ad-3e43ff03174e,remote_ip_prefix=,revision_number=0,security_group_id=9e5e16bb-f37f-4cff-a1ad-3e43ff03174e,updated_at=2022-09-30T09:37:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:52.612204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c2401bf2-43e6-492c-8b01-5d18a047923c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:52.612534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Security group rule updated ['9e5e16bb-f37f-4cff-a1ad-3e43ff03174e'] Sep 30 09:37:52.837000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:37:52Z,description='',dns_domain=None,id=357201ed-46d8-4a8e-b639-1f9bf08174d7,mtu=1500,name='public',project_id='f04f50d086c64df3bc18b4c8f8baadc4',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(357201ed-46d8-4a8e-b639-1f9bf08174d7),segments=[NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:37:52Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:52.837387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b77ebc29-0ff3-41fa-bc72-6e8d4a2e2c9d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (357201ed-46d8-4a8e-b639-1f9bf08174d7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:54.205029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:13 started Sep 30 09:37:54.207650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0172,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=707000000,duration_sec=32,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:54.208285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:54.209223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:13 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:37:56.206443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:14 started Sep 30 09:37:56.209357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0174,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=709000000,duration_sec=34,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:56.209914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:56.210265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:14 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:37:57.001116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0ed49c2-299b-42e0-b299-8fa4db2937b7 demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:37:56Z,data_plane_status=None,description='',device_id='e04f13a7-a566-4fb1-a3e1-91dcbb65e30f',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=452383da-1307-41b6-9960-d5a92f51b39f,mac_address=fa:16:3e:d9:5c:5e,name='',network_id=75af3093-2420-45d6-8e8e-061034438cbf,numa_affinity_policy=,project_id='333c93c6a3ef48b6806ea0d5f14ce211',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(452383da-1307-41b6-9960-d5a92f51b39f),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:37:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:37:57.001615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0ed49c2-299b-42e0-b299-8fa4db2937b7 demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (452383da-1307-41b6-9960-d5a92f51b39f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:57.515994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0ed49c2-299b-42e0-b299-8fa4db2937b7 demo admin] Received resource Port update without any changes: 452383da-1307-41b6-9960-d5a92f51b39f {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 30 09:37:58.207124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:15 started Sep 30 09:37:58.210087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0176,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=710000000,duration_sec=36,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:37:58.210757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:37:58.211175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:15 - starting polling. Elapsed:0.004 Sep 30 09:37:58.212208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:58.213149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:15 - port information retrieved. Elapsed:0.006 Sep 30 09:37:58.213546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:15 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:37:59.283125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-61404008-49b4-4fb6-a890-9b9efd75d41d None None] Resource Port 452383da-1307-41b6-9960-d5a92f51b39f updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=452383da-1307-41b6-9960-d5a92f51b39f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=452383da-1307-41b6-9960-d5a92f51b39f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:37:59.283755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-61404008-49b4-4fb6-a890-9b9efd75d41d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (452383da-1307-41b6-9960-d5a92f51b39f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:37:59.688880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-61404008-49b4-4fb6-a890-9b9efd75d41d None None] Resource Port 452383da-1307-41b6-9960-d5a92f51b39f updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=452383da-1307-41b6-9960-d5a92f51b39f,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=452383da-1307-41b6-9960-d5a92f51b39f,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=452383da-1307-41b6-9960-d5a92f51b39f,segment=NetworkSegment(6a177cda-71bb-400a-88b7-8166ceec6665),segment_id=6a177cda-71bb-400a-88b7-8166ceec6665)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:37:59.689259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-61404008-49b4-4fb6-a890-9b9efd75d41d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (452383da-1307-41b6-9960-d5a92f51b39f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:38:00.057228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8931eea2-540c-49c5-99fd-5a1429ccff40 None None] Resource Port 452383da-1307-41b6-9960-d5a92f51b39f updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:38:00.057778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8931eea2-540c-49c5-99fd-5a1429ccff40 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (452383da-1307-41b6-9960-d5a92f51b39f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:38:00.208218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:16 started Sep 30 09:38:00.211736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0178,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=711000000,duration_sec=38,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:00.212489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:00.212940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:16 - starting polling. Elapsed:0.005 Sep 30 09:38:00.213910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:38:00.214803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:16 - port information retrieved. Elapsed:0.007 Sep 30 09:38:00.215135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:16 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:38:01.595008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b1407bc1-fe21-4269-a3e2-1f858f639285 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(31890959-9144-4b88-8472-3375fd9b750b)],cidr=172.37.6.0/24,created_at=2022-09-30T09:38:01Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.37.6.1,host_routes=[],id=d17ed916-ebf0-4a94-a3d0-5eb91b98323c,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='public-subnet',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,project_id='f04f50d086c64df3bc18b4c8f8baadc4',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:38:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:38:01.595653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b1407bc1-fe21-4269-a3e2-1f858f639285 admin admin] Publish callbacks [] for Subnet (d17ed916-ebf0-4a94-a3d0-5eb91b98323c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:38:02.208798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:17 started Sep 30 09:38:02.211367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c017a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=711000000,duration_sec=40,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:02.212032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:02.212479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:17 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:04.210064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:18 started Sep 30 09:38:04.212487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c017c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=712000000,duration_sec=42,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:04.213042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:04.213566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:18 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:04.599887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["16265a8d-821e-4558-ac0a-485307ac593d","insert","qr-452383da-13",["set",[]],["map",[["attached-mac","fa:16:3e:d9:5c:5e"],["iface-id","452383da-1307-41b6-9960-d5a92f51b39f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:38:04.617671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["16265a8d-821e-4558-ac0a-485307ac593d","old",null,["set",[]],null],["","new","qr-452383da-13",3,["map",[["attached-mac","fa:16:3e:d9:5c:5e"],["iface-id","452383da-1307-41b6-9960-d5a92f51b39f"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:38:06.066671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8bb12e0b-0cfa-429b-894f-0b5fc7589c2a demo admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:38:05Z,data_plane_status=None,description='',device_id='e04f13a7-a566-4fb1-a3e1-91dcbb65e30f',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0a907ef6-0733-4f96-9909-bd47d7e38800,mac_address=fa:16:3e:f4:bd:f9,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0a907ef6-0733-4f96-9909-bd47d7e38800),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:38:05Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:38:06.067885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8bb12e0b-0cfa-429b-894f-0b5fc7589c2a demo admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0a907ef6-0733-4f96-9909-bd47d7e38800), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:38:06.210667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:19 started Sep 30 09:38:06.213411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c017e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=713000000,duration_sec=44,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:06.214066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:06.214622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:19 - starting polling. Elapsed:0.004 Sep 30 09:38:06.215753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:38:06.216830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:19 - port information retrieved. Elapsed:0.006 Sep 30 09:38:06.217230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a'}, 'added': {'452383da-1307-41b6-9960-d5a92f51b39f'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:38:06.217844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '452383da-1307-41b6-9960-d5a92f51b39f', 'device_id': 'e04f13a7-a566-4fb1-a3e1-91dcbb65e30f', 'network_id': '75af3093-2420-45d6-8e8e-061034438cbf', 'port_id': '452383da-1307-41b6-9960-d5a92f51b39f', 'mac_address': 'fa:16:3e:d9:5c:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 377, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c4bbdd90-ebba-4442-8512-fdcef6a79e53', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:38:06.218920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 452383da-1307-41b6-9960-d5a92f51b39f {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:38:06.219307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 452383da-1307-41b6-9960-d5a92f51b39f updated. Details: {'device': '452383da-1307-41b6-9960-d5a92f51b39f', 'device_id': 'e04f13a7-a566-4fb1-a3e1-91dcbb65e30f', 'network_id': '75af3093-2420-45d6-8e8e-061034438cbf', 'port_id': '452383da-1307-41b6-9960-d5a92f51b39f', 'mac_address': 'fa:16:3e:d9:5c:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 377, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'c4bbdd90-ebba-4442-8512-fdcef6a79e53', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 1} Sep 30 09:38:06.220316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-452383da-13, col_values=(('tag', 1),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:38:06.220796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-452383da-13, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:38:06.221304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-452383da-13, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:38:06.226300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-452383da-13, col_values=(('other_config', {'net_uuid': '75af3093-2420-45d6-8e8e-061034438cbf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '1', 'segmentation_id': '377'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:38:06.232931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0180,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 3}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:06.233327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:19 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 2 devices currently available. Time elapsed: 0.016 Sep 30 09:38:06.233734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:38:06.234093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'452383da-1307-41b6-9960-d5a92f51b39f'} Sep 30 09:38:06.235298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:38:06.235637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:38:06.237433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:38:06.273364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8310e91-3253-4a7f-a4e0-5e3e30ff9c24]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:38:06.273978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:19 - agent port security group processed in 0.056 Sep 30 09:38:06.274552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 452383da-1307-41b6-9960-d5a92f51b39f to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:38:06.399429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['452383da-1307-41b6-9960-d5a92f51b39f'] and devices down [] completed. Sep 30 09:38:06.399755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:19 - ports processed. Elapsed:0.189 Sep 30 09:38:06.400097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:19 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.190 Sep 30 09:38:08.089475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-639bf37f-aafe-4e0f-8dbe-0d833519579f None None] Resource Port 0a907ef6-0733-4f96-9909-bd47d7e38800 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=0a907ef6-0733-4f96-9909-bd47d7e38800,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0a907ef6-0733-4f96-9909-bd47d7e38800,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:38:08.090053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-639bf37f-aafe-4e0f-8dbe-0d833519579f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0a907ef6-0733-4f96-9909-bd47d7e38800), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:38:08.211873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:20 started Sep 30 09:38:08.214264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0182,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=714000000,duration_sec=46,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:08.214843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:08.215175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:20 - starting polling. Elapsed:0.004 Sep 30 09:38:08.216220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:38:08.217289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:20 - port information retrieved. Elapsed:0.006 Sep 30 09:38:08.217615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:20 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:38:08.348825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-639bf37f-aafe-4e0f-8dbe-0d833519579f None None] Resource Port 0a907ef6-0733-4f96-9909-bd47d7e38800 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0a907ef6-0733-4f96-9909-bd47d7e38800,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0a907ef6-0733-4f96-9909-bd47d7e38800,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0a907ef6-0733-4f96-9909-bd47d7e38800,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:38:08.349309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-639bf37f-aafe-4e0f-8dbe-0d833519579f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0a907ef6-0733-4f96-9909-bd47d7e38800), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:38:08.678961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ef467586-6950-4933-ac73-4dace328fb7d","insert","qg-0a907ef6-07",["set",[]],["map",[["attached-mac","fa:16:3e:f4:bd:f9"],["iface-id","0a907ef6-0733-4f96-9909-bd47d7e38800"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:38:08.691874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ef467586-6950-4933-ac73-4dace328fb7d","old",null,["set",[]],null],["","new","qg-0a907ef6-07",4,["map",[["attached-mac","fa:16:3e:f4:bd:f9"],["iface-id","0a907ef6-0733-4f96-9909-bd47d7e38800"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:38:10.212660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:21 started Sep 30 09:38:10.215266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0184,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=715000000,duration_sec=48,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:10.215797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:10.216260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:21 - starting polling. Elapsed:0.004 Sep 30 09:38:10.217467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:38:10.218655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:21 - port information retrieved. Elapsed:0.006 Sep 30 09:38:10.218977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '0a907ef6-0733-4f96-9909-bd47d7e38800'}, 'added': {'0a907ef6-0733-4f96-9909-bd47d7e38800'}, 'removed': set(), 'updated': {'0a907ef6-0733-4f96-9909-bd47d7e38800'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:38:10.219596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '0a907ef6-0733-4f96-9909-bd47d7e38800', 'device_id': 'e04f13a7-a566-4fb1-a3e1-91dcbb65e30f', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '0a907ef6-0733-4f96-9909-bd47d7e38800', 'mac_address': 'fa:16:3e:f4:bd:f9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.150'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:38:10.221418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 0a907ef6-0733-4f96-9909-bd47d7e38800 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:38:10.221418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 0a907ef6-0733-4f96-9909-bd47d7e38800 updated. Details: {'device': '0a907ef6-0733-4f96-9909-bd47d7e38800', 'device_id': 'e04f13a7-a566-4fb1-a3e1-91dcbb65e30f', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '0a907ef6-0733-4f96-9909-bd47d7e38800', 'mac_address': 'fa:16:3e:f4:bd:f9', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.150'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:38:10.221418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 2 as local vlan for net-id=357201ed-46d8-4a8e-b639-1f9bf08174d7, seg-id=None Sep 30 09:38:10.224575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xc9105ee6,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPopVlan(len=8,type=18), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=32,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4098}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:10.227356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xf1c0186,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionPushVlan(ethertype=33024,len=8,type=17), OFPActionSetField(vlan_vid=4098)],len=32,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 0}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:10.228349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0a907ef6-07, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:38:10.228810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-0a907ef6-07, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:38:10.229631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-0a907ef6-07, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:38:10.235223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0a907ef6-07, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:38:10.242391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0188,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:10.242841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:21 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.023 Sep 30 09:38:10.243191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:38:10.243489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'0a907ef6-0733-4f96-9909-bd47d7e38800'} Sep 30 09:38:10.244627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:38:10.244916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:38:10.246955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:38:10.292685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd3d01f-d411-4454-911a-ddb7875bcf0b]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:38:10.293308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:21 - agent port security group processed in 0.074 Sep 30 09:38:10.293897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 0a907ef6-0733-4f96-9909-bd47d7e38800 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:38:10.508709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['0a907ef6-0733-4f96-9909-bd47d7e38800'] and devices down [] completed. Sep 30 09:38:10.509110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:21 - ports processed. Elapsed:0.297 Sep 30 09:38:10.509484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:21 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.297 Sep 30 09:38:10.563000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port 0a907ef6-0733-4f96-9909-bd47d7e38800 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0a907ef6-0733-4f96-9909-bd47d7e38800,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0a907ef6-0733-4f96-9909-bd47d7e38800,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:38:10.563248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0a907ef6-0733-4f96-9909-bd47d7e38800), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:38:12.214068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:22 started Sep 30 09:38:12.216570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c018a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=716000000,duration_sec=50,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:12.217297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:12.217631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:22 - starting polling. Elapsed:0.004 Sep 30 09:38:12.218814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:38:12.220321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:22 - port information retrieved. Elapsed:0.006 Sep 30 09:38:12.220321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '0a907ef6-0733-4f96-9909-bd47d7e38800'}, 'added': set(), 'removed': set(), 'updated': {'0a907ef6-0733-4f96-9909-bd47d7e38800'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:38:12.220939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '0a907ef6-0733-4f96-9909-bd47d7e38800', 'device_id': 'e04f13a7-a566-4fb1-a3e1-91dcbb65e30f', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '0a907ef6-0733-4f96-9909-bd47d7e38800', 'mac_address': 'fa:16:3e:f4:bd:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.150'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:38:12.224833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 0a907ef6-0733-4f96-9909-bd47d7e38800 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:38:12.225155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 0a907ef6-0733-4f96-9909-bd47d7e38800 updated. Details: {'device': '0a907ef6-0733-4f96-9909-bd47d7e38800', 'device_id': 'e04f13a7-a566-4fb1-a3e1-91dcbb65e30f', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '0a907ef6-0733-4f96-9909-bd47d7e38800', 'mac_address': 'fa:16:3e:f4:bd:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.150'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:38:12.226397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0a907ef6-07, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:38:12.226853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-0a907ef6-07, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:38:12.227270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-0a907ef6-07, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:38:12.227710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:38:12.228453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-0a907ef6-07, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:38:12.229088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:38:12.232239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c018c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 4}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:12.232574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:22 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 3 devices currently available. Time elapsed: 0.012 Sep 30 09:38:12.232920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:38:12.233204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:38:12.234313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:38:12.234611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:38:12.237033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:38:12.278463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0b2f27-5fa4-484e-bc83-0c732c71fd22]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:38:12.279139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:22 - agent port security group processed in 0.059 Sep 30 09:38:12.279735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 0a907ef6-0733-4f96-9909-bd47d7e38800 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:38:12.507576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['0a907ef6-0733-4f96-9909-bd47d7e38800'] and devices down [] completed. Sep 30 09:38:12.508005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:22 - ports processed. Elapsed:0.294 Sep 30 09:38:12.508489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:22 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.295 Sep 30 09:38:14.215440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:23 started Sep 30 09:38:14.220309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c018e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=720000000,duration_sec=52,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:14.221676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:14.222280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:23 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:38:16.217355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:24 started Sep 30 09:38:16.222092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0190,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=720000000,duration_sec=54,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:16.223049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:16.223631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:24 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:38:18.219655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:25 started Sep 30 09:38:18.225743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0192,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=722000000,duration_sec=56,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:18.226313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:18.226713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:25 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:38:20.229208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:26 started Sep 30 09:38:20.229208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0194,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=723000000,duration_sec=58,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:20.229208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:20.229208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:26 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:22.222412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:27 started Sep 30 09:38:22.225358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0196,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=725000000,duration_sec=60,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:22.225984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:22.226346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:27 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:24.223450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:28 started Sep 30 09:38:24.225929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0198,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=725000000,duration_sec=62,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:24.226489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:24.226898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:28 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:26.224430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:29 started Sep 30 09:38:26.228082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c019a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=728000000,duration_sec=64,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:26.229324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:26.230119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:29 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:38:28.226146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:30 started Sep 30 09:38:28.228833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c019c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=728000000,duration_sec=66,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:28.229486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:28.229742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:30 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:30.226950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:31 started Sep 30 09:38:30.229324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c019e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=729000000,duration_sec=68,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:30.229949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:30.230375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:31 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:32.228345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:32 started Sep 30 09:38:32.232437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=731000000,duration_sec=70,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:32.234458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:32.235290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:32 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:38:34.229216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:33 started Sep 30 09:38:34.231732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=731000000,duration_sec=72,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:34.232293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:34.232678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:33 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:36.230675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:34 started Sep 30 09:38:36.233449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=733000000,duration_sec=74,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:36.233682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:36.234287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:34 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:38.231585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:35 started Sep 30 09:38:38.235889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=735000000,duration_sec=76,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:38.236743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:38.237307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:35 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:38:40.233225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:36 started Sep 30 09:38:40.246034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=736000000,duration_sec=78,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:40.247279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:40.247851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:36 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 30 09:38:42.234983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:37 started Sep 30 09:38:42.237810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=738000000,duration_sec=80,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:42.238452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:42.238890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:37 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:44.236810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:38 started Sep 30 09:38:44.239936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=739000000,duration_sec=82,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:44.240639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:44.241064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:38 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:46.237592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:39 started Sep 30 09:38:46.240757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=740000000,duration_sec=84,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:46.241345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:46.241711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:39 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:48.239160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:40 started Sep 30 09:38:48.242315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=742000000,duration_sec=86,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:48.242957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:48.243382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:40 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:50.240075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:41 started Sep 30 09:38:50.242392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=742000000,duration_sec=88,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:50.243040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:50.243453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:41 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:38:52.241291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:42 started Sep 30 09:38:52.243690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=743000000,duration_sec=90,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:52.244244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:52.244590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:42 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:38:54.243918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:43 started Sep 30 09:38:54.248655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=748000000,duration_sec=92,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:54.249505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:54.250078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:43 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:38:56.245188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:44 started Sep 30 09:38:56.248483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01b8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=748000000,duration_sec=94,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:56.249309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:56.249946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:44 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:38:58.247122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:45 started Sep 30 09:38:58.249871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01ba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=749000000,duration_sec=96,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:38:58.250798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:38:58.251372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:45 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:00.248198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:46 started Sep 30 09:39:00.251690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=751000000,duration_sec=98,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:00.252495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:00.257912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:46 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:39:02.253781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:47 started Sep 30 09:39:02.259121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01be,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=756000000,duration_sec=100,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:02.259732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:02.260092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:47 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:39:04.254799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:48 started Sep 30 09:39:04.259168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01c0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=759000000,duration_sec=102,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:04.259994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:04.260567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:48 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:39:06.256269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:49 started Sep 30 09:39:06.259019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01c2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=758000000,duration_sec=104,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:06.259774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:06.260327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:49 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:39:08.257329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:50 started Sep 30 09:39:08.259874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=760000000,duration_sec=106,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:08.260478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:08.260834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:50 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:10.257997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:51 started Sep 30 09:39:10.260371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01c6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=760000000,duration_sec=108,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:10.260965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:10.261323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:51 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:12.259146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:52 started Sep 30 09:39:12.261760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=761000000,duration_sec=110,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:12.262277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:12.262682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:52 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:14.260720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:53 started Sep 30 09:39:14.263280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=763000000,duration_sec=112,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:14.263832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:14.264176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:53 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:16.262249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:54 started Sep 30 09:39:16.264783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=765000000,duration_sec=114,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:16.265370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:16.265730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:54 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:18.263039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:55 started Sep 30 09:39:18.265415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=765000000,duration_sec=116,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:18.265966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:18.266315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:55 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:39:20.263512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:56 started Sep 30 09:39:20.265864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=766000000,duration_sec=118,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:20.266465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:20.266850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:56 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:39:22.264333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:57 started Sep 30 09:39:22.270982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=767000000,duration_sec=120,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:22.271574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:22.271928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:57 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:39:24.265429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:58 started Sep 30 09:39:24.267881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=768000000,duration_sec=122,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:24.268436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:24.268788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:58 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:26.266508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:59 started Sep 30 09:39:26.269772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=769000000,duration_sec=124,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:26.270549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:26.270941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:59 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:39:28.267618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:60 started Sep 30 09:39:28.270120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=770000000,duration_sec=126,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:28.270712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:28.271070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:60 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:30.268852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:61 started Sep 30 09:39:30.271403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01da,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=771000000,duration_sec=128,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:30.271977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:30.272331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:61 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:32.270266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:62 started Sep 30 09:39:32.273162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=773000000,duration_sec=130,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:32.273727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:32.274082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:62 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:34.271972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:63 started Sep 30 09:39:34.274503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01de,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=774000000,duration_sec=132,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:34.275123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:34.275476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:63 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:36.273664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:64 started Sep 30 09:39:36.276122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01e0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=776000000,duration_sec=134,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:36.276687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:36.277033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:64 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:38.275163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:65 started Sep 30 09:39:38.277646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=777000000,duration_sec=136,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:38.278298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:38.278707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:65 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:40.012626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c68a1ab9-0d13-46b8-9d4f-ca1332a96600 admin admin] Resource Subnet c4bbdd90-ebba-4442-8512-fdcef6a79e53 updated (revision_number 0->1). Old fields: {'dns_nameservers': []} New fields: {'dns_nameservers': [DNSNameServer(address='8.8.8.8',order=0,subnet_id=c4bbdd90-ebba-4442-8512-fdcef6a79e53), DNSNameServer(address='8.8.4.4',order=1,subnet_id=c4bbdd90-ebba-4442-8512-fdcef6a79e53)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:39:40.013301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c68a1ab9-0d13-46b8-9d4f-ca1332a96600 admin admin] Publish callbacks [] for Subnet (c4bbdd90-ebba-4442-8512-fdcef6a79e53), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:39:40.276436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:66 started Sep 30 09:39:40.278951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=779000000,duration_sec=138,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:40.279516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:40.279869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:66 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:42.277390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:67 started Sep 30 09:39:42.279826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01e6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=780000000,duration_sec=140,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:42.280437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:42.280793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:67 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:44.278253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:68 started Sep 30 09:39:44.281117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01e8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=781000000,duration_sec=142,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:44.282239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:44.282585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:68 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:46.279069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:69 started Sep 30 09:39:46.281840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=781000000,duration_sec=144,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:46.282402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:46.282792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:69 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:48.280282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:70 started Sep 30 09:39:48.282865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=783000000,duration_sec=146,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:48.283616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:48.283971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:70 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:50.282002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:71 started Sep 30 09:39:50.284308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01ee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=784000000,duration_sec=148,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:50.284863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:50.285216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:71 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:39:52.283344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:72 started Sep 30 09:39:52.285835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=786000000,duration_sec=150,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:52.286393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:52.286775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:72 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:54.284624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:73 started Sep 30 09:39:54.287405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01f2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=787000000,duration_sec=152,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:54.287969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:54.288321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:73 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:39:56.285768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:74 started Sep 30 09:39:56.292413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01f4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=788000000,duration_sec=154,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:56.292980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:56.293329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:74 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:39:58.287207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:75 started Sep 30 09:39:58.289610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=789000000,duration_sec=156,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:39:58.290164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:39:58.290519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:75 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:00.287902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:76 started Sep 30 09:40:00.290184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01f8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=790000000,duration_sec=158,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:00.290778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:00.291131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:76 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:40:02.288710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:77 started Sep 30 09:40:02.291142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01fa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=791000000,duration_sec=160,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:02.291704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:02.292089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:77 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:04.289596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:78 started Sep 30 09:40:04.292169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01fc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=792000000,duration_sec=162,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:04.292790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:04.293193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:78 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:06.290264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:79 started Sep 30 09:40:06.293031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c01fe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=793000000,duration_sec=164,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:06.293586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:06.293931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:79 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:08.291478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:80 started Sep 30 09:40:08.293843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0200,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=794000000,duration_sec=166,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:08.294390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:08.294770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:80 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:40:10.292937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:81 started Sep 30 09:40:10.295419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0202,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=795000000,duration_sec=168,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:10.295975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:10.296354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:81 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:12.293783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:82 started Sep 30 09:40:12.296950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0204,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=796000000,duration_sec=170,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:12.297764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:12.298236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:82 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:40:14.294839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:83 started Sep 30 09:40:14.297352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0206,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=797000000,duration_sec=172,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:14.297909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:14.298259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:83 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:16.296191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:84 started Sep 30 09:40:16.298800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0208,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=799000000,duration_sec=174,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:16.299352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:16.299700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:84 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:18.297700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:85 started Sep 30 09:40:18.300198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c020a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=800000000,duration_sec=176,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:18.300755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:18.301130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:85 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:20.298398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:86 started Sep 30 09:40:20.300748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c020c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=801000000,duration_sec=178,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:20.301297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:20.301664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:86 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:40:22.299045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:87 started Sep 30 09:40:22.301545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c020e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=801000000,duration_sec=180,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:22.302101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:22.302449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:87 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:24.299971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:88 started Sep 30 09:40:24.302814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0210,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=802000000,duration_sec=182,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:24.303805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:24.304156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:88 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:26.301590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:89 started Sep 30 09:40:26.304236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0212,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=804000000,duration_sec=184,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:26.304786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:26.305128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:89 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:28.302670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:90 started Sep 30 09:40:28.305107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0214,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=805000000,duration_sec=186,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:28.305674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:28.306024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:90 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:30.303388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:91 started Sep 30 09:40:30.305957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0216,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=806000000,duration_sec=188,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:30.306527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:30.306906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:91 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:32.304103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:92 started Sep 30 09:40:32.306670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0218,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=806000000,duration_sec=190,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:32.307228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:32.307611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:92 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:34.304947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:93 started Sep 30 09:40:34.312395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c021a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=807000000,duration_sec=192,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:34.312395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:34.312395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:93 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:36.306691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:94 started Sep 30 09:40:36.309127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c021c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=809000000,duration_sec=194,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:36.310202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:36.310549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:94 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:38.307916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:95 started Sep 30 09:40:38.310468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c021e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=810000000,duration_sec=196,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:38.311044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:38.311398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:95 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:39.632360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-68140829-e62a-46d8-ae11-0556e31e2f82 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:40:39Z,description='',dns_domain=None,id=12053c4e-c351-40a7-b2e4-33aed16dfa36,mtu=1500,name='shared',project_id='f04f50d086c64df3bc18b4c8f8baadc4',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(12053c4e-c351-40a7-b2e4-33aed16dfa36),segments=[NetworkSegment(6fa4ec80-7280-443d-9bff-e3974e62ecfa)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:40:39Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:40:39.639437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-68140829-e62a-46d8-ae11-0556e31e2f82 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (12053c4e-c351-40a7-b2e4-33aed16dfa36), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:40:39.803981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-68140829-e62a-46d8-ae11-0556e31e2f82 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 12053c4e-c351-40a7-b2e4-33aed16dfa36 with segmentation id not found. Sep 30 09:40:39.803981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:40:39.803981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:40:39.803981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:40:39.803981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:40:39.803981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:40:39.803981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:40:39.803981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:40:39.803981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:40:39.803981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:40:39.803981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:40:39.803981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:40:39.803981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:40:39.805151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:40:39.805151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:40:39.805151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:40:39.805151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 12053c4e-c351-40a7-b2e4-33aed16dfa36 with segmentation id not found. Sep 30 09:40:39.805151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:40:40.308783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:96 started Sep 30 09:40:40.311144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0220,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=811000000,duration_sec=198,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:40.311791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:40.312144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:96 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:42.309967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:97 started Sep 30 09:40:42.312457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0222,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=812000000,duration_sec=200,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:42.313023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:42.313376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:97 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:43.037291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9afb62d1-d55d-42fc-9e7c-3baea5a2a14e admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(678b7229-1296-458b-9642-40482c400594)],cidr=192.168.233.0/24,created_at=2022-09-30T09:40:42Z,description='shared-subnet',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=192.168.233.1,host_routes=[],id=1709c78e-ce9a-4597-8077-64dbb251f1de,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='shared-subnet',network_id=12053c4e-c351-40a7-b2e4-33aed16dfa36,project_id='f04f50d086c64df3bc18b4c8f8baadc4',revision_number=0,segment_id=,service_types=[],shared=True,subnetpool_id=,updated_at=2022-09-30T09:40:42Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:40:43.037592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9afb62d1-d55d-42fc-9e7c-3baea5a2a14e admin admin] Publish callbacks [] for Subnet (1709c78e-ce9a-4597-8077-64dbb251f1de), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:40:43.791345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-de1218bb-04ea-47c0-bf24-e1bad81dc996 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:40:43Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-12053c4e-c351-40a7-b2e4-33aed16dfa36',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=06250f14-1fc9-460b-b40b-16a566560978,mac_address=fa:16:3e:b4:25:43,name='',network_id=12053c4e-c351-40a7-b2e4-33aed16dfa36,numa_affinity_policy=,project_id='f04f50d086c64df3bc18b4c8f8baadc4',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(06250f14-1fc9-460b-b40b-16a566560978),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:40:43Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:40:43.791937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-de1218bb-04ea-47c0-bf24-e1bad81dc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (06250f14-1fc9-460b-b40b-16a566560978), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:40:44.070819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-de1218bb-04ea-47c0-bf24-e1bad81dc996 None None] Resource Port 06250f14-1fc9-460b-b40b-16a566560978 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=06250f14-1fc9-460b-b40b-16a566560978,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=06250f14-1fc9-460b-b40b-16a566560978,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=06250f14-1fc9-460b-b40b-16a566560978,segment=NetworkSegment(6fa4ec80-7280-443d-9bff-e3974e62ecfa),segment_id=6fa4ec80-7280-443d-9bff-e3974e62ecfa)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:40:44.071198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-de1218bb-04ea-47c0-bf24-e1bad81dc996 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (06250f14-1fc9-460b-b40b-16a566560978), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:40:44.158129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7e90b2da-4519-49ec-9ccb-d58f1a6a2292","insert","tap06250f14-1f",["set",[]],["map",[["attached-mac","fa:16:3e:b4:25:43"],["iface-id","06250f14-1fc9-460b-b40b-16a566560978"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:40:44.178946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["7e90b2da-4519-49ec-9ccb-d58f1a6a2292","old",null,["set",[]],null],["","new","tap06250f14-1f",5,["map",[["attached-mac","fa:16:3e:b4:25:43"],["iface-id","06250f14-1fc9-460b-b40b-16a566560978"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:40:44.310860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:98 started Sep 30 09:40:44.313766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0224,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=814000000,duration_sec=202,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:44.314405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:44.314968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:98 - starting polling. Elapsed:0.004 Sep 30 09:40:44.316530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:40:44.317864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:98 - port information retrieved. Elapsed:0.007 Sep 30 09:40:44.318187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '0a907ef6-0733-4f96-9909-bd47d7e38800', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': {'06250f14-1fc9-460b-b40b-16a566560978'}, 'removed': set(), 'updated': {'06250f14-1fc9-460b-b40b-16a566560978'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:40:44.318835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '06250f14-1fc9-460b-b40b-16a566560978', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-12053c4e-c351-40a7-b2e4-33aed16dfa36', 'network_id': '12053c4e-c351-40a7-b2e4-33aed16dfa36', 'port_id': '06250f14-1fc9-460b-b40b-16a566560978', 'mac_address': 'fa:16:3e:b4:25:43', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 382, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1709c78e-ce9a-4597-8077-64dbb251f1de', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:40:44.320543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 06250f14-1fc9-460b-b40b-16a566560978 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:40:44.321046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 06250f14-1fc9-460b-b40b-16a566560978 updated. Details: {'device': '06250f14-1fc9-460b-b40b-16a566560978', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-12053c4e-c351-40a7-b2e4-33aed16dfa36', 'network_id': '12053c4e-c351-40a7-b2e4-33aed16dfa36', 'port_id': '06250f14-1fc9-460b-b40b-16a566560978', 'mac_address': 'fa:16:3e:b4:25:43', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 382, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1709c78e-ce9a-4597-8077-64dbb251f1de', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:40:44.321375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 3 as local vlan for net-id=12053c4e-c351-40a7-b2e4-33aed16dfa36, seg-id=382 Sep 30 09:40:44.324188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xc9105ee8,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4478), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4099}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:44.327265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xf1c0226,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4099)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4478}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:44.327711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap06250f14-1f, col_values=(('tag', 3),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:40:44.328148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap06250f14-1f, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:40:44.328583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap06250f14-1f, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:40:44.333044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap06250f14-1f, col_values=(('other_config', {'net_uuid': '12053c4e-c351-40a7-b2e4-33aed16dfa36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '3', 'segmentation_id': '382'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:40:44.339464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0228,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 5}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:44.339763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:98 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 4 devices currently available. Time elapsed: 0.021 Sep 30 09:40:44.340718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:40:44.341589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'06250f14-1fc9-460b-b40b-16a566560978'} Sep 30 09:40:44.342281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:40:44.342569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:40:44.344914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:40:44.391409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[44366d6b-7891-4d98-9e34-43bd7f2a333a]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:40:44.391962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:98 - agent port security group processed in 0.073 Sep 30 09:40:44.392569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 06250f14-1fc9-460b-b40b-16a566560978 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:40:44.611154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['06250f14-1fc9-460b-b40b-16a566560978'] and devices down [] completed. Sep 30 09:40:44.611541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:98 - ports processed. Elapsed:0.301 Sep 30 09:40:44.611965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:98 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.301 Sep 30 09:40:44.676910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port 06250f14-1fc9-460b-b40b-16a566560978 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:40:44.677348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (06250f14-1fc9-460b-b40b-16a566560978), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:40:46.312018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:99 started Sep 30 09:40:46.315016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c022a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=814000000,duration_sec=204,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:46.315593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:46.315943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:99 - starting polling. Elapsed:0.004 Sep 30 09:40:46.317188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:40:46.318556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:99 - port information retrieved. Elapsed:0.007 Sep 30 09:40:46.318899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '0a907ef6-0733-4f96-9909-bd47d7e38800', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': set(), 'updated': {'06250f14-1fc9-460b-b40b-16a566560978'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:40:46.319454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '06250f14-1fc9-460b-b40b-16a566560978', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-12053c4e-c351-40a7-b2e4-33aed16dfa36', 'network_id': '12053c4e-c351-40a7-b2e4-33aed16dfa36', 'port_id': '06250f14-1fc9-460b-b40b-16a566560978', 'mac_address': 'fa:16:3e:b4:25:43', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 382, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1709c78e-ce9a-4597-8077-64dbb251f1de', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:40:46.320703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 06250f14-1fc9-460b-b40b-16a566560978 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:40:46.321008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 06250f14-1fc9-460b-b40b-16a566560978 updated. Details: {'device': '06250f14-1fc9-460b-b40b-16a566560978', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-12053c4e-c351-40a7-b2e4-33aed16dfa36', 'network_id': '12053c4e-c351-40a7-b2e4-33aed16dfa36', 'port_id': '06250f14-1fc9-460b-b40b-16a566560978', 'mac_address': 'fa:16:3e:b4:25:43', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 382, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1709c78e-ce9a-4597-8077-64dbb251f1de', 'ip_address': '192.168.233.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 3} Sep 30 09:40:46.321998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap06250f14-1f, col_values=(('tag', 3),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:40:46.322424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap06250f14-1f, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:40:46.322873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap06250f14-1f, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:40:46.323317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:40:46.324068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap06250f14-1f, col_values=(('other_config', {'net_uuid': '12053c4e-c351-40a7-b2e4-33aed16dfa36', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '382', 'tag': '3'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:40:46.324746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:40:46.326985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c022c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 5}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:46.327329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:99 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 4 devices currently available. Time elapsed: 0.008 Sep 30 09:40:46.327676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:40:46.327962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:40:46.329075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:40:46.329368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:40:46.331420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:40:46.376641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[88953412-ec53-4f85-a21d-a2d66c2ac418]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:40:46.377269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:99 - agent port security group processed in 0.058 Sep 30 09:40:46.377869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 06250f14-1fc9-460b-b40b-16a566560978 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:40:46.504092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['06250f14-1fc9-460b-b40b-16a566560978'] and devices down [] completed. Sep 30 09:40:46.504654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:99 - ports processed. Elapsed:0.193 Sep 30 09:40:46.509051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:99 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.193 Sep 30 09:40:48.313080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:100 started Sep 30 09:40:48.315726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c022e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=815000000,duration_sec=206,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:48.316290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:48.316643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:100 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:50.313924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:101 started Sep 30 09:40:50.316311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0230,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=816000000,duration_sec=208,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:50.316860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:50.317229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:101 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:40:52.315191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:102 started Sep 30 09:40:52.317548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0232,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=817000000,duration_sec=210,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:52.318093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:52.318440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:102 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:40:54.316699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:103 started Sep 30 09:40:54.319110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0234,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=819000000,duration_sec=212,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:54.319660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:54.320047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:103 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:40:56.317867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:104 started Sep 30 09:40:56.320331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0236,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=820000000,duration_sec=214,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:56.320878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:56.321236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:104 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:40:58.318867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:105 started Sep 30 09:40:58.321516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0238,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=821000000,duration_sec=216,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:40:58.322074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:40:58.322427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:105 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:00.320171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:106 started Sep 30 09:41:00.322753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c023a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=823000000,duration_sec=218,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:00.323311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:00.323659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:106 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:02.320872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:107 started Sep 30 09:41:02.323354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c023c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=823000000,duration_sec=220,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:02.323918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:02.324269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:107 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:04.322077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:108 started Sep 30 09:41:04.325224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c023e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=824000000,duration_sec=222,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:04.325903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:04.326256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:108 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:06.322949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:109 started Sep 30 09:41:06.326036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0240,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=825000000,duration_sec=224,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:06.326620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:06.326969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:109 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:08.324172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:110 started Sep 30 09:41:08.326622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0242,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=826000000,duration_sec=226,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:08.327258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:08.327612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:110 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:10.325645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:111 started Sep 30 09:41:10.328089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0244,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=828000000,duration_sec=228,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:10.328652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:10.329005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:111 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:12.326977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:112 started Sep 30 09:41:12.329376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0246,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=829000000,duration_sec=230,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:12.329935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:12.330471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:112 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:14.328219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:113 started Sep 30 09:41:14.331273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0248,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=831000000,duration_sec=232,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:14.331848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:14.332199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:113 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:16.329867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:114 started Sep 30 09:41:16.332351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c024a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=832000000,duration_sec=234,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:16.332908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:16.333261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:114 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:18.330744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:115 started Sep 30 09:41:18.333156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c024c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=833000000,duration_sec=236,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:18.333715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:18.334073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:115 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:20.331783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:116 started Sep 30 09:41:20.334317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c024e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=834000000,duration_sec=238,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:20.334911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:20.335290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:116 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:22.332986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:117 started Sep 30 09:41:22.335483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0250,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=835000000,duration_sec=240,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:22.336040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:22.336420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:117 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:24.333588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:118 started Sep 30 09:41:24.335984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0252,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=836000000,duration_sec=242,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:24.336565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:24.336915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:118 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:41:26.335197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:119 started Sep 30 09:41:26.337672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0254,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=837000000,duration_sec=244,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:26.338222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:26.339095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:119 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:28.337026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:120 started Sep 30 09:41:28.340366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0256,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=839000000,duration_sec=246,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:28.340930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:28.341283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:120 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:30.337749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:121 started Sep 30 09:41:30.340219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0258,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=840000000,duration_sec=248,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:30.340770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:30.341213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:121 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:32.339166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:122 started Sep 30 09:41:32.341606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c025a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=841000000,duration_sec=250,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:32.342162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:32.342527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:122 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:34.340451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:123 started Sep 30 09:41:34.342752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c025c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=843000000,duration_sec=252,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:34.345052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:34.345052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:123 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:41:36.341544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:124 started Sep 30 09:41:36.344157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c025e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=844000000,duration_sec=254,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:36.344716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:36.345071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:124 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:38.342747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:125 started Sep 30 09:41:38.345540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0260,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=845000000,duration_sec=256,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:38.346102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:38.346452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:125 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:40.344226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:126 started Sep 30 09:41:40.346607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0262,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=846000000,duration_sec=258,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:40.347175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:40.347526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:126 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:41:42.345845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:127 started Sep 30 09:41:42.348428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0264,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=848000000,duration_sec=260,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:42.349017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:42.349370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:127 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:44.346652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:128 started Sep 30 09:41:44.348911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0266,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=849000000,duration_sec=262,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:44.349452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:44.349819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:128 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:41:46.347480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:129 started Sep 30 09:41:46.349927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0268,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=850000000,duration_sec=264,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:46.350492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:46.350898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:129 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:48.348354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:130 started Sep 30 09:41:48.350821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c026a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=851000000,duration_sec=266,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:48.351383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:48.351735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:130 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:50.349006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:131 started Sep 30 09:41:50.351468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c026c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=851000000,duration_sec=268,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:50.352018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:50.352384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:131 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:52.350702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:132 started Sep 30 09:41:52.353102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c026e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=853000000,duration_sec=270,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:52.353660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:52.354014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:132 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:54.351520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:133 started Sep 30 09:41:54.354752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0270,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=854000000,duration_sec=272,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:54.355565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:54.355920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:133 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:41:56.353054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:134 started Sep 30 09:41:56.355483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0272,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=855000000,duration_sec=274,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:56.356033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:56.356387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:134 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:41:58.354238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:135 started Sep 30 09:41:58.356704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0274,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=856000000,duration_sec=276,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:41:58.357260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:41:58.357609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:135 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:00.355452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:136 started Sep 30 09:42:00.357869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0276,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=858000000,duration_sec=278,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:00.358421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:00.358888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:136 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:02.356970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:137 started Sep 30 09:42:02.359581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0278,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=859000000,duration_sec=280,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:02.360137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:02.360484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:137 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:04.358367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:138 started Sep 30 09:42:04.360861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c027a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=861000000,duration_sec=282,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:04.361423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:04.361771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:138 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:06.360156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:139 started Sep 30 09:42:06.362804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c027c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=863000000,duration_sec=284,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:06.363362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:06.363712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:139 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:08.361680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:140 started Sep 30 09:42:08.364139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c027e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=864000000,duration_sec=286,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:08.364730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:08.365079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:140 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:10.362580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:141 started Sep 30 09:42:10.365153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0280,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=865000000,duration_sec=288,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:10.365710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:10.366063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:141 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:12.363812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:142 started Sep 30 09:42:12.366276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0282,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=866000000,duration_sec=290,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:12.367370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:12.367739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:142 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:14.364710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:143 started Sep 30 09:42:14.367363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0284,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=867000000,duration_sec=292,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:14.367925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:14.368277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:143 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:16.366114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:144 started Sep 30 09:42:16.369100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0286,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=869000000,duration_sec=294,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:16.369658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:16.370007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:144 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:18.367601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:145 started Sep 30 09:42:18.370522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0288,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=870000000,duration_sec=296,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:18.371188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:18.371684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:145 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:20.368979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:146 started Sep 30 09:42:20.372623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c028a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=872000000,duration_sec=298,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:20.373391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:20.374069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:146 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:42:22.370445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:147 started Sep 30 09:42:22.372966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c028c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=873000000,duration_sec=300,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:22.373529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:22.373884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:147 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:24.371696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:148 started Sep 30 09:42:24.374115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c028e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=874000000,duration_sec=302,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:24.374774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:24.375142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:148 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:26.373090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:149 started Sep 30 09:42:26.375574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0290,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=875000000,duration_sec=304,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:26.376144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:26.376492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:149 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:27.393826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:42:27Z,description='Default security group',id=74420ba7-9248-45b8-a826-c80c43db819b,is_default=True,name='default',project_id='1118d289e02347d1bb08a0008d5d64d0',revision_number=1,rules=[SecurityGroupRule(3ed9f38a-7ef9-4521-b1e6-9e8eba71425b),SecurityGroupRule(b8b35e7a-cd7d-4f4f-9bab-ca9d55fb7474),SecurityGroupRule(eb18ed91-a19c-428a-8478-22e373514d61),SecurityGroupRule(fb9149ae-bdec-4348-8ff3-10e431080a66)],shared=False,stateful=True,updated_at=2022-09-30T09:42:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:42:27.394497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (74420ba7-9248-45b8-a826-c80c43db819b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:42:27.394997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:42:27Z,description=,direction='ingress',ethertype='IPv6',id=3ed9f38a-7ef9-4521-b1e6-9e8eba71425b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1118d289e02347d1bb08a0008d5d64d0',protocol=,remote_address_group_id=,remote_group_id=74420ba7-9248-45b8-a826-c80c43db819b,remote_ip_prefix=,revision_number=0,security_group_id=74420ba7-9248-45b8-a826-c80c43db819b,updated_at=2022-09-30T09:42:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:42:27.395362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (3ed9f38a-7ef9-4521-b1e6-9e8eba71425b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:42:27.395698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Security group rule updated ['74420ba7-9248-45b8-a826-c80c43db819b'] Sep 30 09:42:27.396409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:42:27Z,description=,direction='egress',ethertype='IPv6',id=b8b35e7a-cd7d-4f4f-9bab-ca9d55fb7474,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1118d289e02347d1bb08a0008d5d64d0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=74420ba7-9248-45b8-a826-c80c43db819b,updated_at=2022-09-30T09:42:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:42:27.396897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b8b35e7a-cd7d-4f4f-9bab-ca9d55fb7474), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:42:27.397329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Security group rule updated ['74420ba7-9248-45b8-a826-c80c43db819b'] Sep 30 09:42:27.398032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:42:27Z,description=,direction='ingress',ethertype='IPv4',id=eb18ed91-a19c-428a-8478-22e373514d61,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1118d289e02347d1bb08a0008d5d64d0',protocol=,remote_address_group_id=,remote_group_id=74420ba7-9248-45b8-a826-c80c43db819b,remote_ip_prefix=,revision_number=0,security_group_id=74420ba7-9248-45b8-a826-c80c43db819b,updated_at=2022-09-30T09:42:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:42:27.398387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (eb18ed91-a19c-428a-8478-22e373514d61), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:42:27.398735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Security group rule updated ['74420ba7-9248-45b8-a826-c80c43db819b'] Sep 30 09:42:27.399396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:42:27Z,description=,direction='egress',ethertype='IPv4',id=fb9149ae-bdec-4348-8ff3-10e431080a66,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1118d289e02347d1bb08a0008d5d64d0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=74420ba7-9248-45b8-a826-c80c43db819b,updated_at=2022-09-30T09:42:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:42:27.399750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (fb9149ae-bdec-4348-8ff3-10e431080a66), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:42:27.400076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-570c502e-4214-4e05-84bf-c09a52b422ef admin admin] Security group rule updated ['74420ba7-9248-45b8-a826-c80c43db819b'] Sep 30 09:42:27.608187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Resource SecurityGroup deleted: 74420ba7-9248-45b8-a826-c80c43db819b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:42:27.608629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (74420ba7-9248-45b8-a826-c80c43db819b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:42:27.609282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('74420ba7-9248-45b8-a826-c80c43db819b',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:42:27.628851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('74420ba7-9248-45b8-a826-c80c43db819b',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:42:27.629368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Resource SecurityGroupRule deleted: 3ed9f38a-7ef9-4521-b1e6-9e8eba71425b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:42:27.630067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (3ed9f38a-7ef9-4521-b1e6-9e8eba71425b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:42:27.630405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Security group rule updated ['74420ba7-9248-45b8-a826-c80c43db819b'] Sep 30 09:42:27.630822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Resource SecurityGroupRule deleted: b8b35e7a-cd7d-4f4f-9bab-ca9d55fb7474 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:42:27.631166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b8b35e7a-cd7d-4f4f-9bab-ca9d55fb7474), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:42:27.632081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Security group rule updated ['74420ba7-9248-45b8-a826-c80c43db819b'] Sep 30 09:42:27.632635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Resource SecurityGroupRule deleted: eb18ed91-a19c-428a-8478-22e373514d61 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:42:27.632981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (eb18ed91-a19c-428a-8478-22e373514d61), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:42:27.633295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Security group rule updated ['74420ba7-9248-45b8-a826-c80c43db819b'] Sep 30 09:42:27.633657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Resource SecurityGroupRule deleted: fb9149ae-bdec-4348-8ff3-10e431080a66 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:42:27.633994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (fb9149ae-bdec-4348-8ff3-10e431080a66), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:42:27.634301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-be3b0879-2578-4e1b-b125-7a1d160f041f admin admin] Security group rule updated ['74420ba7-9248-45b8-a826-c80c43db819b'] Sep 30 09:42:28.374501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:150 started Sep 30 09:42:28.377081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0292,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=877000000,duration_sec=306,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:28.377902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:28.378247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:150 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:30.375613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:151 started Sep 30 09:42:30.378502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0294,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=878000000,duration_sec=308,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:30.379092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:30.379446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:151 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:32.376815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:152 started Sep 30 09:42:32.379563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0296,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=879000000,duration_sec=310,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:32.380108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:32.380451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:152 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:34.377799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:153 started Sep 30 09:42:34.380343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0298,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=880000000,duration_sec=312,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:34.380901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:34.381277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:153 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:36.378428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:154 started Sep 30 09:42:36.381493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c029a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=881000000,duration_sec=314,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:36.382051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:36.382405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:154 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:38.379815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:155 started Sep 30 09:42:38.385273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c029c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=882000000,duration_sec=316,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:38.385829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:38.386280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:155 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:42:40.381024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:156 started Sep 30 09:42:40.383540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c029e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=883000000,duration_sec=318,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:40.384099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:40.384444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:156 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:42.382350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:157 started Sep 30 09:42:42.384780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=885000000,duration_sec=320,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:42.385341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:42.385692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:157 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:44.383606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:158 started Sep 30 09:42:44.385874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=886000000,duration_sec=322,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:44.386428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:44.386803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:158 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:42:46.384431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:159 started Sep 30 09:42:46.390327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=887000000,duration_sec=324,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:46.390916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:46.391262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:159 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:42:48.385938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:160 started Sep 30 09:42:48.388293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=888000000,duration_sec=326,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:48.388843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:48.389186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:160 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:42:50.387102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:161 started Sep 30 09:42:50.389378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=889000000,duration_sec=328,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:50.389919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:50.390264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:161 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:42:52.388537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:162 started Sep 30 09:42:52.390921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=891000000,duration_sec=330,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:52.391512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:52.391857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:162 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:42:54.389565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:163 started Sep 30 09:42:54.391895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=892000000,duration_sec=332,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:54.392447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:54.392790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:163 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:42:56.390163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:164 started Sep 30 09:42:56.392589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=892000000,duration_sec=334,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:56.393150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:56.393499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:164 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:42:58.391317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:165 started Sep 30 09:42:58.393665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=894000000,duration_sec=336,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:42:58.394224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:42:58.394565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:165 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:00.392562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:166 started Sep 30 09:43:00.394953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=895000000,duration_sec=338,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:00.396028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:00.396378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:166 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:02.394218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:167 started Sep 30 09:43:02.397199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=896000000,duration_sec=340,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:02.397793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:02.398146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:167 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:04.394807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:168 started Sep 30 09:43:04.397118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=897000000,duration_sec=342,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:04.397671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:04.398013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:168 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:06.396211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:169 started Sep 30 09:43:06.398562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02b8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=898000000,duration_sec=344,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:06.399141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:06.399480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:169 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:08.397455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:170 started Sep 30 09:43:08.399823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02ba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=900000000,duration_sec=346,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:08.400375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:08.400716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:170 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:10.398258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:171 started Sep 30 09:43:10.400600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=900000000,duration_sec=348,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:10.401159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:10.401511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:171 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:12.399149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:172 started Sep 30 09:43:12.401524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02be,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=901000000,duration_sec=350,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:12.402115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:12.402464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:172 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:14.400199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:173 started Sep 30 09:43:14.403344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02c0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=903000000,duration_sec=352,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:14.403947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:14.404283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:173 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:16.401624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:174 started Sep 30 09:43:16.404124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02c2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=904000000,duration_sec=354,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:16.404686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:16.405029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:174 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:18.403017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:175 started Sep 30 09:43:18.405421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=905000000,duration_sec=356,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:18.405979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:18.406324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:175 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:20.403619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:176 started Sep 30 09:43:20.406000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02c6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=906000000,duration_sec=358,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:20.406551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:20.406928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:176 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:22.404296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:177 started Sep 30 09:43:22.406835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=907000000,duration_sec=360,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:22.407398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:22.407747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:177 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:24.404915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:178 started Sep 30 09:43:24.407278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=907000000,duration_sec=362,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:24.407838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:24.408186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:178 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:26.406381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:179 started Sep 30 09:43:26.408832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=909000000,duration_sec=364,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:26.409391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:26.409735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:179 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:28.407581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:180 started Sep 30 09:43:28.410040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=910000000,duration_sec=366,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:28.410637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:28.410996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:180 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:30.408534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:181 started Sep 30 09:43:30.410875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=911000000,duration_sec=368,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:30.411426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:30.411773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:181 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:32.409938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:182 started Sep 30 09:43:32.412340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=912000000,duration_sec=370,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:32.412895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:32.413243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:182 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:34.410901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:183 started Sep 30 09:43:34.413203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=913000000,duration_sec=372,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:34.413794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:34.414140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:183 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:36.412530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:184 started Sep 30 09:43:36.414947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=915000000,duration_sec=374,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:36.415528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:36.415877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:184 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:38.413798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:185 started Sep 30 09:43:38.416181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=916000000,duration_sec=376,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:38.416764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:38.417108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:185 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:40.415009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:186 started Sep 30 09:43:40.417319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02da,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=917000000,duration_sec=378,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:40.417871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:40.418244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:186 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:42.415737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:187 started Sep 30 09:43:42.418123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=918000000,duration_sec=380,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:42.418713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:42.419058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:187 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:44.416219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:188 started Sep 30 09:43:44.418455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02de,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=918000000,duration_sec=382,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:44.419044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:44.419391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:188 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:46.417164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:189 started Sep 30 09:43:46.419551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02e0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=919000000,duration_sec=384,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:46.420131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:46.420477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:189 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:48.418051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:190 started Sep 30 09:43:48.420522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=920000000,duration_sec=386,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:48.421077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:48.421423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:190 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:50.419174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:191 started Sep 30 09:43:50.421511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=921000000,duration_sec=388,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:50.422065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:50.422411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:191 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:43:52.420345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:192 started Sep 30 09:43:52.423123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02e6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=923000000,duration_sec=390,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:52.423631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:52.424010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:192 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:54.421932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:193 started Sep 30 09:43:54.427141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02e8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=924000000,duration_sec=392,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:54.427141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:54.427141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:193 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:56.423049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:194 started Sep 30 09:43:56.426212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=925000000,duration_sec=394,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:56.426833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:56.427184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:194 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:43:58.423801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:195 started Sep 30 09:43:58.426810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=926000000,duration_sec=396,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:43:58.427372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:43:58.427720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:195 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:00.425047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:196 started Sep 30 09:44:00.427409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02ee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=927000000,duration_sec=398,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:00.427958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:00.428301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:196 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:44:02.426388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:197 started Sep 30 09:44:02.428745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=929000000,duration_sec=400,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:02.429295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:02.429660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:197 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:44:04.427394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:198 started Sep 30 09:44:04.429897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02f2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=930000000,duration_sec=402,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:04.430511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:04.430891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:198 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:06.428540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:199 started Sep 30 09:44:06.431195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02f4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=931000000,duration_sec=404,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:06.431782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:06.432159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:199 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:08.429317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:200 started Sep 30 09:44:08.431783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=932000000,duration_sec=406,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:08.432344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:08.432698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:200 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:10.430876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:201 started Sep 30 09:44:10.433188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02f8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=933000000,duration_sec=408,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:10.433768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:10.434112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:201 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:44:12.431934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:202 started Sep 30 09:44:12.434346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02fa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=934000000,duration_sec=410,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:12.434923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:12.435267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:202 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:14.432957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:203 started Sep 30 09:44:14.435426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02fc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=935000000,duration_sec=412,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:14.435988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:14.436338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:203 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:16.433583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:204 started Sep 30 09:44:16.436033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c02fe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=936000000,duration_sec=414,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:16.436621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:16.436986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:204 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:18.434981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:205 started Sep 30 09:44:18.437504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0300,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=937000000,duration_sec=416,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:18.438082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:18.438428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:205 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:20.435659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:206 started Sep 30 09:44:20.438175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0302,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=938000000,duration_sec=418,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:20.438798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:20.439680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:206 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:22.437522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:207 started Sep 30 09:44:22.439973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0304,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=940000000,duration_sec=420,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:22.440525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:22.440881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:207 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:24.438549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:208 started Sep 30 09:44:24.440932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0306,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=941000000,duration_sec=422,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:24.441490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:24.441837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:208 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:44:26.439391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:209 started Sep 30 09:44:26.441867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0308,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=942000000,duration_sec=424,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:26.442431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:26.442820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:209 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:28.440383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:210 started Sep 30 09:44:28.442812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c030a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=943000000,duration_sec=426,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:28.443374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:28.443723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:210 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:30.441324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:211 started Sep 30 09:44:30.443668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c030c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=943000000,duration_sec=428,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:30.444234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:30.444587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:211 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:44:32.442639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:212 started Sep 30 09:44:32.444966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c030e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=945000000,duration_sec=430,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:32.445518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:32.445860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:212 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:44:34.443364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:213 started Sep 30 09:44:34.445662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0310,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=946000000,duration_sec=432,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:34.446220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:34.446566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:213 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:44:36.444896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:214 started Sep 30 09:44:36.447315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0312,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=947000000,duration_sec=434,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:36.447867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:36.448221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:214 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:38.445518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:215 started Sep 30 09:44:38.447945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0314,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=948000000,duration_sec=436,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:38.448449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:38.448797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:215 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:44:40.446682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:216 started Sep 30 09:44:40.449121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0316,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=949000000,duration_sec=438,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:40.449636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:40.449987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:216 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:42.447806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:217 started Sep 30 09:44:42.450266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0318,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=950000000,duration_sec=440,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:42.450788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:42.451135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:217 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:44.449008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:218 started Sep 30 09:44:44.451599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c031a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=951000000,duration_sec=442,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:44.452195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:44.452547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:218 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:46.450110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:219 started Sep 30 09:44:46.452496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c031c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=952000000,duration_sec=444,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:46.453052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:46.453395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:219 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:48.451160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:220 started Sep 30 09:44:48.453446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c031e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=953000000,duration_sec=446,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:48.454002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:48.454350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:220 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:44:50.452230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:221 started Sep 30 09:44:50.454522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0320,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=954000000,duration_sec=448,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:50.455117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:50.455464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:221 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:44:52.452844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:222 started Sep 30 09:44:52.455197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0322,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=955000000,duration_sec=450,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:52.456267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:52.456614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:222 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:54.453719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:223 started Sep 30 09:44:54.460965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0324,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=956000000,duration_sec=452,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:54.461534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:54.461880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:223 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:44:56.454378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:224 started Sep 30 09:44:56.456792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0326,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=957000000,duration_sec=454,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:56.457342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:56.457699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:224 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:44:58.455086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:225 started Sep 30 09:44:58.458258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0328,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=958000000,duration_sec=456,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:44:58.458873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:44:58.459224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:225 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:00.456389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:226 started Sep 30 09:45:00.458767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c032a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=959000000,duration_sec=458,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:00.459327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:00.459680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:226 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:02.457235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:227 started Sep 30 09:45:02.459697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c032c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=959000000,duration_sec=460,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:02.460254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:02.460603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:227 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:04.458305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:228 started Sep 30 09:45:04.461430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c032e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=961000000,duration_sec=462,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:04.462029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:04.462386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:228 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:06.459244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:229 started Sep 30 09:45:06.461940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0330,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=962000000,duration_sec=464,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:06.462516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:06.462928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:229 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:08.460114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:230 started Sep 30 09:45:08.463900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0332,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=963000000,duration_sec=466,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:08.465100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:08.465800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:230 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:45:10.461807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:231 started Sep 30 09:45:10.465020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0334,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=964000000,duration_sec=468,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:10.465857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:10.466446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:231 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:45:12.463316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:232 started Sep 30 09:45:12.465783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0336,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=966000000,duration_sec=470,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:12.466359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:12.466759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:232 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:14.464038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:233 started Sep 30 09:45:14.466544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0338,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=966000000,duration_sec=472,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:14.467128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:14.467474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:233 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:16.465189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:234 started Sep 30 09:45:16.467660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c033a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=967000000,duration_sec=474,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:16.468216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:16.468562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:234 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:18.465764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:235 started Sep 30 09:45:18.468140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c033c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=968000000,duration_sec=476,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:18.468687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:18.469057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:235 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:20.467034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:236 started Sep 30 09:45:20.469377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c033e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=969000000,duration_sec=478,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:20.469932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:20.470282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:236 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:22.468340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:237 started Sep 30 09:45:22.470799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0340,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=971000000,duration_sec=480,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:22.471885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:22.472231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:237 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:24.468972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:238 started Sep 30 09:45:24.471863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0342,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=971000000,duration_sec=482,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:24.472544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:24.472897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:238 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:26.470270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:239 started Sep 30 09:45:26.472654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0344,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=972000000,duration_sec=484,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:26.473253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:26.473700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:239 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:28.471220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:240 started Sep 30 09:45:28.477763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0346,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=973000000,duration_sec=486,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:28.478360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:28.478844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:240 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:45:30.471950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:241 started Sep 30 09:45:30.474390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0348,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=974000000,duration_sec=488,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:30.474974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:30.475327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:241 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:32.472651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:242 started Sep 30 09:45:32.475145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c034a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=975000000,duration_sec=490,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:32.475694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:32.476066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:242 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:34.474047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:243 started Sep 30 09:45:34.476808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c034c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=977000000,duration_sec=492,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:34.477412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:34.477765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:243 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:36.474803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:244 started Sep 30 09:45:36.477251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c034e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=977000000,duration_sec=494,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:36.477807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:36.478151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:244 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:38.475459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:245 started Sep 30 09:45:38.477987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0350,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=978000000,duration_sec=496,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:38.478574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:38.478951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:245 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:40.476656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:246 started Sep 30 09:45:40.479210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0352,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=979000000,duration_sec=498,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:40.479770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:40.480115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:246 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:42.477375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:247 started Sep 30 09:45:42.481591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0354,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=980000000,duration_sec=500,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:42.481591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:42.482293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:247 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:45:44.478841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:248 started Sep 30 09:45:44.482765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0356,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=982000000,duration_sec=502,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:44.483678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:44.484240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:248 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:45:46.479803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:249 started Sep 30 09:45:46.482273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0358,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=982000000,duration_sec=504,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:46.482903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:46.483258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:249 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:45:46.961857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:45:46Z,description='Default security group',id=462c076e-5253-483e-b5c8-ce3514101941,is_default=True,name='default',project_id='f1c0948ddb014e6f93d6069bb5203890',revision_number=1,rules=[SecurityGroupRule(2835e232-08eb-49c2-8214-af22f0898bac),SecurityGroupRule(598dbe34-e500-4c22-a5b1-cf5c35317b40),SecurityGroupRule(b67d73f4-bd19-4397-9c89-148550219d86),SecurityGroupRule(c8ffaaca-5d6f-4b0c-9c35-0d8bfc15004c)],shared=False,stateful=True,updated_at=2022-09-30T09:45:46Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:46.974155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (462c076e-5253-483e-b5c8-ce3514101941), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:46.974155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:46Z,description=,direction='egress',ethertype='IPv6',id=2835e232-08eb-49c2-8214-af22f0898bac,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f1c0948ddb014e6f93d6069bb5203890',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=462c076e-5253-483e-b5c8-ce3514101941,updated_at=2022-09-30T09:45:46Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:46.974155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2835e232-08eb-49c2-8214-af22f0898bac), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:46.974155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Security group rule updated ['462c076e-5253-483e-b5c8-ce3514101941'] Sep 30 09:45:46.974991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:46Z,description=,direction='ingress',ethertype='IPv4',id=598dbe34-e500-4c22-a5b1-cf5c35317b40,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f1c0948ddb014e6f93d6069bb5203890',protocol=,remote_address_group_id=,remote_group_id=462c076e-5253-483e-b5c8-ce3514101941,remote_ip_prefix=,revision_number=0,security_group_id=462c076e-5253-483e-b5c8-ce3514101941,updated_at=2022-09-30T09:45:46Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:46.974991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (598dbe34-e500-4c22-a5b1-cf5c35317b40), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:46.974991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Security group rule updated ['462c076e-5253-483e-b5c8-ce3514101941'] Sep 30 09:45:46.975230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:46Z,description=,direction='egress',ethertype='IPv4',id=b67d73f4-bd19-4397-9c89-148550219d86,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f1c0948ddb014e6f93d6069bb5203890',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=462c076e-5253-483e-b5c8-ce3514101941,updated_at=2022-09-30T09:45:46Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:46.975230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b67d73f4-bd19-4397-9c89-148550219d86), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:46.975230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Security group rule updated ['462c076e-5253-483e-b5c8-ce3514101941'] Sep 30 09:45:46.975493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:46Z,description=,direction='ingress',ethertype='IPv6',id=c8ffaaca-5d6f-4b0c-9c35-0d8bfc15004c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f1c0948ddb014e6f93d6069bb5203890',protocol=,remote_address_group_id=,remote_group_id=462c076e-5253-483e-b5c8-ce3514101941,remote_ip_prefix=,revision_number=0,security_group_id=462c076e-5253-483e-b5c8-ce3514101941,updated_at=2022-09-30T09:45:46Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:46.975493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c8ffaaca-5d6f-4b0c-9c35-0d8bfc15004c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:46.975493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Security group rule updated ['462c076e-5253-483e-b5c8-ce3514101941'] Sep 30 09:45:47.195323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:45:46Z,description='',dns_domain=None,id=069f8527-f158-4f06-809a-7a507bf3fc84,mtu=1500,name='tempest-ServerRescueNegativeTestJSON-686014149-network',project_id='f1c0948ddb014e6f93d6069bb5203890',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(069f8527-f158-4f06-809a-7a507bf3fc84),segments=[NetworkSegment(fc32f094-22aa-44bb-9338-b364f7aad433)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:45:46Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:47.195707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (069f8527-f158-4f06-809a-7a507bf3fc84), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:47.267723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-ec81894c-88bb-4a4d-872b-27b980792b28 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 069f8527-f158-4f06-809a-7a507bf3fc84 with segmentation id not found. Sep 30 09:45:47.267723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:45:47.267723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:45:47.267723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:45:47.267723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:45:47.267723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:45:47.267723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:45:47.267723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:45:47.267723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:45:47.267723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:45:47.267723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:45:47.267723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:45:47.267723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:45:47.268594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:45:47.268594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:45:47.268594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:45:47.268594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 069f8527-f158-4f06-809a-7a507bf3fc84 with segmentation id not found. Sep 30 09:45:47.268594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:45:47.646166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-88bcc909-28e5-4df9-8400-ed0168b41702 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(14810e84-33af-40ce-af43-bf8bac448c56)],cidr=172.20.0.0/28,created_at=2022-09-30T09:45:47Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=5097a34b-c136-47dd-9d48-0761ca5f7a16,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-ServerRescueNegativeTestJSON-686014149-subnet',network_id=069f8527-f158-4f06-809a-7a507bf3fc84,project_id='f1c0948ddb014e6f93d6069bb5203890',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:45:47Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:47.646853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-88bcc909-28e5-4df9-8400-ed0168b41702 admin admin] Publish callbacks [] for Subnet (5097a34b-c136-47dd-9d48-0761ca5f7a16), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:48.480323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-935f979f-3723-4dcc-8a41-88834df76964 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:45:48Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-069f8527-f158-4f06-809a-7a507bf3fc84',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2d9bcc54-7b5a-4444-8ddc-d386c01296fb,mac_address=fa:16:3e:1b:a6:e8,name='',network_id=069f8527-f158-4f06-809a-7a507bf3fc84,numa_affinity_policy=,project_id='f1c0948ddb014e6f93d6069bb5203890',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2d9bcc54-7b5a-4444-8ddc-d386c01296fb),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:45:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:48.480707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-935f979f-3723-4dcc-8a41-88834df76964 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (2d9bcc54-7b5a-4444-8ddc-d386c01296fb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:48.481640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:250 started Sep 30 09:45:48.484365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c035a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=984000000,duration_sec=506,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:48.485916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:48.486483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:250 - starting polling. Elapsed:0.005 Sep 30 09:45:48.488254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:48.496005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:250 - port information retrieved. Elapsed:0.014 Sep 30 09:45:48.501310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:250 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 30 09:45:48.916687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-935f979f-3723-4dcc-8a41-88834df76964 None None] Resource Port 2d9bcc54-7b5a-4444-8ddc-d386c01296fb updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2d9bcc54-7b5a-4444-8ddc-d386c01296fb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2d9bcc54-7b5a-4444-8ddc-d386c01296fb,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=2d9bcc54-7b5a-4444-8ddc-d386c01296fb,segment=NetworkSegment(fc32f094-22aa-44bb-9338-b364f7aad433),segment_id=fc32f094-22aa-44bb-9338-b364f7aad433)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:45:48.921125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-935f979f-3723-4dcc-8a41-88834df76964 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (2d9bcc54-7b5a-4444-8ddc-d386c01296fb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:49.024312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:45:48Z,description='Default security group',id=36a8dc30-8d9a-4b94-899b-74bfa1118bd6,is_default=True,name='default',project_id='b7f6b7ca2f3b4c20ab58940f7e24c1ed',revision_number=1,rules=[SecurityGroupRule(84cf0d03-0fd0-481d-9bd4-e9848e910694),SecurityGroupRule(8838d7e6-4fdd-4cc9-86bb-9e03336d9452),SecurityGroupRule(9a409d20-e214-40ee-99d8-ecec0499f290),SecurityGroupRule(f456c664-a8a5-42ef-96ba-78d50996d4d5)],shared=False,stateful=True,updated_at=2022-09-30T09:45:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:49.024689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (36a8dc30-8d9a-4b94-899b-74bfa1118bd6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:49.026192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:48Z,description=,direction='ingress',ethertype='IPv6',id=84cf0d03-0fd0-481d-9bd4-e9848e910694,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b7f6b7ca2f3b4c20ab58940f7e24c1ed',protocol=,remote_address_group_id=,remote_group_id=36a8dc30-8d9a-4b94-899b-74bfa1118bd6,remote_ip_prefix=,revision_number=0,security_group_id=36a8dc30-8d9a-4b94-899b-74bfa1118bd6,updated_at=2022-09-30T09:45:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:49.027017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (84cf0d03-0fd0-481d-9bd4-e9848e910694), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:49.028585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Security group rule updated ['36a8dc30-8d9a-4b94-899b-74bfa1118bd6'] Sep 30 09:45:49.029653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:48Z,description=,direction='ingress',ethertype='IPv4',id=8838d7e6-4fdd-4cc9-86bb-9e03336d9452,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b7f6b7ca2f3b4c20ab58940f7e24c1ed',protocol=,remote_address_group_id=,remote_group_id=36a8dc30-8d9a-4b94-899b-74bfa1118bd6,remote_ip_prefix=,revision_number=0,security_group_id=36a8dc30-8d9a-4b94-899b-74bfa1118bd6,updated_at=2022-09-30T09:45:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:49.030541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8838d7e6-4fdd-4cc9-86bb-9e03336d9452), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:49.031928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Security group rule updated ['36a8dc30-8d9a-4b94-899b-74bfa1118bd6'] Sep 30 09:45:49.034860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:48Z,description=,direction='egress',ethertype='IPv6',id=9a409d20-e214-40ee-99d8-ecec0499f290,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b7f6b7ca2f3b4c20ab58940f7e24c1ed',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=36a8dc30-8d9a-4b94-899b-74bfa1118bd6,updated_at=2022-09-30T09:45:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:49.035937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (9a409d20-e214-40ee-99d8-ecec0499f290), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:49.039917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Security group rule updated ['36a8dc30-8d9a-4b94-899b-74bfa1118bd6'] Sep 30 09:45:49.039917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:48Z,description=,direction='egress',ethertype='IPv4',id=f456c664-a8a5-42ef-96ba-78d50996d4d5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b7f6b7ca2f3b4c20ab58940f7e24c1ed',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=36a8dc30-8d9a-4b94-899b-74bfa1118bd6,updated_at=2022-09-30T09:45:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:49.039917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f456c664-a8a5-42ef-96ba-78d50996d4d5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:49.039917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Security group rule updated ['36a8dc30-8d9a-4b94-899b-74bfa1118bd6'] Sep 30 09:45:49.051012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1c873a73-54de-47d2-93c3-af87a8793033","insert","tap2d9bcc54-7b",["set",[]],["map",[["attached-mac","fa:16:3e:1b:a6:e8"],["iface-id","2d9bcc54-7b5a-4444-8ddc-d386c01296fb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:45:49.183540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1c873a73-54de-47d2-93c3-af87a8793033","old",null,["set",[]],null],["","new","tap2d9bcc54-7b",6,["map",[["attached-mac","fa:16:3e:1b:a6:e8"],["iface-id","2d9bcc54-7b5a-4444-8ddc-d386c01296fb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:45:49.333092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:45:48Z,description='Default security group',id=25b84d94-8875-4bc4-b8d2-6a7836938f01,is_default=True,name='default',project_id='86e6b0501cb94028be07bddd2182638b',revision_number=1,rules=[SecurityGroupRule(31a286f4-99f3-4fca-97eb-d4feacdcea74),SecurityGroupRule(4d97f982-0680-4030-849f-e2eb36a887f1),SecurityGroupRule(5eb56400-0672-4474-a1d4-f54586e24277),SecurityGroupRule(c8315914-f464-4dd1-8244-53ca9d565a69)],shared=False,stateful=True,updated_at=2022-09-30T09:45:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:49.341111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (25b84d94-8875-4bc4-b8d2-6a7836938f01), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:49.341111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:48Z,description=,direction='egress',ethertype='IPv4',id=31a286f4-99f3-4fca-97eb-d4feacdcea74,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=25b84d94-8875-4bc4-b8d2-6a7836938f01,updated_at=2022-09-30T09:45:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:49.341111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (31a286f4-99f3-4fca-97eb-d4feacdcea74), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:49.341111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Security group rule updated ['25b84d94-8875-4bc4-b8d2-6a7836938f01'] Sep 30 09:45:49.341669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:48Z,description=,direction='egress',ethertype='IPv6',id=4d97f982-0680-4030-849f-e2eb36a887f1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=25b84d94-8875-4bc4-b8d2-6a7836938f01,updated_at=2022-09-30T09:45:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:49.341669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4d97f982-0680-4030-849f-e2eb36a887f1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:49.341669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Security group rule updated ['25b84d94-8875-4bc4-b8d2-6a7836938f01'] Sep 30 09:45:49.341931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:48Z,description=,direction='ingress',ethertype='IPv6',id=5eb56400-0672-4474-a1d4-f54586e24277,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol=,remote_address_group_id=,remote_group_id=25b84d94-8875-4bc4-b8d2-6a7836938f01,remote_ip_prefix=,revision_number=0,security_group_id=25b84d94-8875-4bc4-b8d2-6a7836938f01,updated_at=2022-09-30T09:45:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:49.341931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5eb56400-0672-4474-a1d4-f54586e24277), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:49.341931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Security group rule updated ['25b84d94-8875-4bc4-b8d2-6a7836938f01'] Sep 30 09:45:49.342461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:48Z,description=,direction='ingress',ethertype='IPv4',id=c8315914-f464-4dd1-8244-53ca9d565a69,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol=,remote_address_group_id=,remote_group_id=25b84d94-8875-4bc4-b8d2-6a7836938f01,remote_ip_prefix=,revision_number=0,security_group_id=25b84d94-8875-4bc4-b8d2-6a7836938f01,updated_at=2022-09-30T09:45:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:49.343239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c8315914-f464-4dd1-8244-53ca9d565a69), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:49.343807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Security group rule updated ['25b84d94-8875-4bc4-b8d2-6a7836938f01'] Sep 30 09:45:49.559576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:45:48Z,description='',dns_domain=None,id=5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3,mtu=1500,name='tempest-DeleteServersTestJSON-1410603125-network',project_id='b7f6b7ca2f3b4c20ab58940f7e24c1ed',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3),segments=[NetworkSegment(2ac308fb-7102-4667-bb4c-5798a82aae29)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:45:49Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:49.565043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:49.648917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-853c7a5e-d36d-488d-a0b1-32d8818782de admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3 with segmentation id not found. Sep 30 09:45:49.648917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:45:49.648917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:45:49.648917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:45:49.648917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:45:49.648917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:45:49.648917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:45:49.648917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:45:49.648917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:45:49.648917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:45:49.648917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:45:49.648917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:45:49.648917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:45:49.649828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:45:49.649828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:45:49.649828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:45:49.649828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3 with segmentation id not found. Sep 30 09:45:49.649828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:45:49.660105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:45:49Z,description='',dns_domain=None,id=d038a068-f643-497f-8e6f-7d6e8fb5892b,mtu=1500,name='tempest-AttachVolumeNegativeTest-1378623099-network',project_id='86e6b0501cb94028be07bddd2182638b',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(d038a068-f643-497f-8e6f-7d6e8fb5892b),segments=[NetworkSegment(e6b17fb5-eb11-41c5-b8ac-1188c97e0520)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:45:49Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:49.660878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (d038a068-f643-497f-8e6f-7d6e8fb5892b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:49.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-0749f7c5-daf1-476e-b6f7-9c52d4017539 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network d038a068-f643-497f-8e6f-7d6e8fb5892b with segmentation id not found. Sep 30 09:45:49.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:45:49.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:45:49.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:45:49.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:45:49.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:45:49.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:45:49.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:45:49.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:45:49.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:45:49.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:45:49.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:45:49.783475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:45:49.784508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:45:49.784508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:45:49.784508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:45:49.784508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network d038a068-f643-497f-8e6f-7d6e8fb5892b with segmentation id not found. Sep 30 09:45:49.784508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:45:50.036744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6e732364-5e0d-4e6a-bc5c-2ec8b00a1d97 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:45:49Z,data_plane_status=None,description='',device_id='b196b2b1-9467-425b-85bb-6d6c105b12be',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=233f84ff-dc41-412a-921b-4b701aa6e0c9,mac_address=fa:16:3e:84:bb:3b,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(233f84ff-dc41-412a-921b-4b701aa6e0c9),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:45:49Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:50.040531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6e732364-5e0d-4e6a-bc5c-2ec8b00a1d97 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (233f84ff-dc41-412a-921b-4b701aa6e0c9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:50.475784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a560e74-5cd8-4f2c-8ca7-0d9d12c9507e admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(17f09d13-db5e-4252-a4bd-e1d7350bd1be)],cidr=172.20.0.0/28,created_at=2022-09-30T09:45:49Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=60a86eb6-daf2-49f6-a6fa-6f3fdc65436e,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-DeleteServersTestJSON-1410603125-subnet',network_id=5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3,project_id='b7f6b7ca2f3b4c20ab58940f7e24c1ed',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:45:49Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:50.476634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a560e74-5cd8-4f2c-8ca7-0d9d12c9507e admin admin] Publish callbacks [] for Subnet (60a86eb6-daf2-49f6-a6fa-6f3fdc65436e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:50.483336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:251 started Sep 30 09:45:50.486401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c035c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=986000000,duration_sec=508,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:50.487026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:50.488593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:251 - starting polling. Elapsed:0.004 Sep 30 09:45:50.489065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:50.490508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:251 - port information retrieved. Elapsed:0.007 Sep 30 09:45:50.491772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800'}, 'added': {'2d9bcc54-7b5a-4444-8ddc-d386c01296fb'}, 'removed': set(), 'updated': {'2d9bcc54-7b5a-4444-8ddc-d386c01296fb'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:45:50.493323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-069f8527-f158-4f06-809a-7a507bf3fc84', 'network_id': '069f8527-f158-4f06-809a-7a507bf3fc84', 'port_id': '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'mac_address': 'fa:16:3e:1b:a6:e8', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5097a34b-c136-47dd-9d48-0761ca5f7a16', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:45:50.499101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 2d9bcc54-7b5a-4444-8ddc-d386c01296fb {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:45:50.499693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 2d9bcc54-7b5a-4444-8ddc-d386c01296fb updated. Details: {'device': '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-069f8527-f158-4f06-809a-7a507bf3fc84', 'network_id': '069f8527-f158-4f06-809a-7a507bf3fc84', 'port_id': '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'mac_address': 'fa:16:3e:1b:a6:e8', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5097a34b-c136-47dd-9d48-0761ca5f7a16', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:45:50.500217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 4 as local vlan for net-id=069f8527-f158-4f06-809a-7a507bf3fc84, seg-id=391 Sep 30 09:45:50.504197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xc9105eea,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4487), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:50.514199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xf1c035e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4100)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4487}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:50.518607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap2d9bcc54-7b, col_values=(('tag', 4),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:50.519087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap2d9bcc54-7b, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:50.519721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap2d9bcc54-7b, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:50.533282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap2d9bcc54-7b, col_values=(('other_config', {'net_uuid': '069f8527-f158-4f06-809a-7a507bf3fc84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '391'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:50.556224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0360,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:50.556597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:251 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 5 devices currently available. Time elapsed: 0.064 Sep 30 09:45:50.557822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:45:50.559704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'2d9bcc54-7b5a-4444-8ddc-d386c01296fb'} Sep 30 09:45:50.562140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:45:50.562437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:45:50.570830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:45:50.670301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[77baaf31-e69e-4fcc-a5dc-702584b93e68]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:45:50.671192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:251 - agent port security group processed in 0.178 Sep 30 09:45:50.671971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 2d9bcc54-7b5a-4444-8ddc-d386c01296fb to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:45:50.755483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-69f683b8-6558-417d-94fa-d8d61231075f admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(820e1fd2-ec64-4931-b205-c6fc217900e1)],cidr=172.20.0.0/28,created_at=2022-09-30T09:45:50Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=6f2733e7-5dbc-4e5f-b1d7-072b1b8aee4d,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeNegativeTest-1378623099-subnet',network_id=d038a068-f643-497f-8e6f-7d6e8fb5892b,project_id='86e6b0501cb94028be07bddd2182638b',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:45:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:50.755868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-69f683b8-6558-417d-94fa-d8d61231075f admin admin] Publish callbacks [] for Subnet (6f2733e7-5dbc-4e5f-b1d7-072b1b8aee4d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:50.865489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-fa705d6c-c188-4c64-b276-2bd69c085f04 None None] Resource Port 2d9bcc54-7b5a-4444-8ddc-d386c01296fb updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:45:50.866106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-fa705d6c-c188-4c64-b276-2bd69c085f04 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (2d9bcc54-7b5a-4444-8ddc-d386c01296fb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:51.396585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['2d9bcc54-7b5a-4444-8ddc-d386c01296fb'] and devices down [] completed. Sep 30 09:45:51.397668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:251 - ports processed. Elapsed:0.914 Sep 30 09:45:51.398237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:251 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.915 Sep 30 09:45:52.262043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7f901577-f2ae-490d-b82a-ff4732690970 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:45:51Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c147afeb-a580-4f58-9be3-0d2e0482431c,mac_address=fa:16:3e:ca:5f:df,name='',network_id=5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3,numa_affinity_policy=,project_id='b7f6b7ca2f3b4c20ab58940f7e24c1ed',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c147afeb-a580-4f58-9be3-0d2e0482431c),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:45:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:52.262434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7f901577-f2ae-490d-b82a-ff4732690970 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c147afeb-a580-4f58-9be3-0d2e0482431c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:52.325209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3be3a956-3177-47ec-aa71-17030b787d53 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:45:51Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d038a068-f643-497f-8e6f-7d6e8fb5892b',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3291eabc-8476-48e1-90b3-0e49bcde606a,mac_address=fa:16:3e:ba:74:cd,name='',network_id=d038a068-f643-497f-8e6f-7d6e8fb5892b,numa_affinity_policy=,project_id='86e6b0501cb94028be07bddd2182638b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3291eabc-8476-48e1-90b3-0e49bcde606a),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:45:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:52.325599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3be3a956-3177-47ec-aa71-17030b787d53 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3291eabc-8476-48e1-90b3-0e49bcde606a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:52.484449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:252 started Sep 30 09:45:52.487899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0362,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=988000000,duration_sec=510,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:52.488704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:52.488935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:252 - starting polling. Elapsed:0.005 Sep 30 09:45:52.490267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:52.492642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:252 - port information retrieved. Elapsed:0.008 Sep 30 09:45:52.492642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800'}, 'added': set(), 'removed': set(), 'updated': {'2d9bcc54-7b5a-4444-8ddc-d386c01296fb'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:45:52.498641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-069f8527-f158-4f06-809a-7a507bf3fc84', 'network_id': '069f8527-f158-4f06-809a-7a507bf3fc84', 'port_id': '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'mac_address': 'fa:16:3e:1b:a6:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5097a34b-c136-47dd-9d48-0761ca5f7a16', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:45:52.498641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 2d9bcc54-7b5a-4444-8ddc-d386c01296fb {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:45:52.498802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 2d9bcc54-7b5a-4444-8ddc-d386c01296fb updated. Details: {'device': '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-069f8527-f158-4f06-809a-7a507bf3fc84', 'network_id': '069f8527-f158-4f06-809a-7a507bf3fc84', 'port_id': '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'mac_address': 'fa:16:3e:1b:a6:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5097a34b-c136-47dd-9d48-0761ca5f7a16', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Sep 30 09:45:52.498802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap2d9bcc54-7b, col_values=(('tag', 4),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:52.498802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap2d9bcc54-7b, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:52.498981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap2d9bcc54-7b, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:52.498981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:45:52.503595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap2d9bcc54-7b, col_values=(('other_config', {'net_uuid': '069f8527-f158-4f06-809a-7a507bf3fc84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '391', 'tag': '4'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:52.504596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:45:52.507168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0364,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:52.507759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:252 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 5 devices currently available. Time elapsed: 0.015 Sep 30 09:45:52.508448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:45:52.509349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:45:52.510849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:45:52.511579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:45:52.514996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:45:52.596904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2aa596-5bb6-47ae-8f67-1b1a98153855]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:45:52.597635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:252 - agent port security group processed in 0.105 Sep 30 09:45:52.598262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 2d9bcc54-7b5a-4444-8ddc-d386c01296fb to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:45:52.816108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7c300b0c-587c-47d7-bcd8-c16ced82b19f admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:45:52Z,data_plane_status=None,description='',device_id='b7ac0da4-bd4a-40ed-a8fb-31ade94ecb43',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac,mac_address=fa:16:3e:73:ee:49,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:45:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:52.816499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7c300b0c-587c-47d7-bcd8-c16ced82b19f admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:52.958246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['2d9bcc54-7b5a-4444-8ddc-d386c01296fb'] and devices down [] completed. Sep 30 09:45:52.958853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:252 - ports processed. Elapsed:0.475 Sep 30 09:45:52.962380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:252 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.475 Sep 30 09:45:53.010031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7f901577-f2ae-490d-b82a-ff4732690970 None None] Resource Port c147afeb-a580-4f58-9be3-0d2e0482431c updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c147afeb-a580-4f58-9be3-0d2e0482431c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c147afeb-a580-4f58-9be3-0d2e0482431c,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c147afeb-a580-4f58-9be3-0d2e0482431c,segment=NetworkSegment(2ac308fb-7102-4667-bb4c-5798a82aae29),segment_id=2ac308fb-7102-4667-bb4c-5798a82aae29)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:45:53.010804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7f901577-f2ae-490d-b82a-ff4732690970 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c147afeb-a580-4f58-9be3-0d2e0482431c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:53.081792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3be3a956-3177-47ec-aa71-17030b787d53 None None] Resource Port 3291eabc-8476-48e1-90b3-0e49bcde606a updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3291eabc-8476-48e1-90b3-0e49bcde606a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=3291eabc-8476-48e1-90b3-0e49bcde606a,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=3291eabc-8476-48e1-90b3-0e49bcde606a,segment=NetworkSegment(e6b17fb5-eb11-41c5-b8ac-1188c97e0520),segment_id=e6b17fb5-eb11-41c5-b8ac-1188c97e0520)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:45:53.082203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3be3a956-3177-47ec-aa71-17030b787d53 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3291eabc-8476-48e1-90b3-0e49bcde606a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:53.154098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["77737eee-9f13-4970-b0a0-9f3fe7f02c00","insert","tapc147afeb-a5",["set",[]],["map",[["attached-mac","fa:16:3e:ca:5f:df"],["iface-id","c147afeb-a580-4f58-9be3-0d2e0482431c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:45:53.166897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["77737eee-9f13-4970-b0a0-9f3fe7f02c00","old",null,["set",[]],null],["","new","tapc147afeb-a5",7,["map",[["attached-mac","fa:16:3e:ca:5f:df"],["iface-id","c147afeb-a580-4f58-9be3-0d2e0482431c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:45:53.301077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6dcb3477-9ed3-4c33-8388-11f5029d8408","insert","tap3291eabc-84",["set",[]],["map",[["attached-mac","fa:16:3e:ba:74:cd"],["iface-id","3291eabc-8476-48e1-90b3-0e49bcde606a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:45:53.318073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6dcb3477-9ed3-4c33-8388-11f5029d8408","old",null,["set",[]],null],["","new","tap3291eabc-84",8,["map",[["attached-mac","fa:16:3e:ba:74:cd"],["iface-id","3291eabc-8476-48e1-90b3-0e49bcde606a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:45:53.853909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ac9563c8-885d-47f3-a103-f2d9230d70d3 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:45:52Z,data_plane_status=None,description='',device_id='cdd64d18-309c-47c2-a505-81317a69bcb9',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a814a09a-4d8f-4407-894b-fc4aa5feb85d,mac_address=fa:16:3e:f9:c2:fe,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a814a09a-4d8f-4407-894b-fc4aa5feb85d),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:45:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:53.854980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ac9563c8-885d-47f3-a103-f2d9230d70d3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (a814a09a-4d8f-4407-894b-fc4aa5feb85d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:53.871220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-141f31cc-b156-42bb-bc8b-7236f6e2cffb None None] Resource Port 233f84ff-dc41-412a-921b-4b701aa6e0c9 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=233f84ff-dc41-412a-921b-4b701aa6e0c9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=233f84ff-dc41-412a-921b-4b701aa6e0c9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:45:53.874648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-141f31cc-b156-42bb-bc8b-7236f6e2cffb None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (233f84ff-dc41-412a-921b-4b701aa6e0c9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:54.001329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-769b198f-3e88-4406-8f1b-e6534cceb9c2 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:45:52Z,data_plane_status=None,description='',device_id='b196b2b1-9467-425b-85bb-6d6c105b12be',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c1feeb13-170b-4980-9c93-30ea7a94b340,mac_address=fa:16:3e:c3:56:a6,name='',network_id=069f8527-f158-4f06-809a-7a507bf3fc84,numa_affinity_policy=,project_id='f1c0948ddb014e6f93d6069bb5203890',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c1feeb13-170b-4980-9c93-30ea7a94b340),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:45:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:54.001708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-769b198f-3e88-4406-8f1b-e6534cceb9c2 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c1feeb13-170b-4980-9c93-30ea7a94b340), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:54.151188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-141f31cc-b156-42bb-bc8b-7236f6e2cffb None None] Resource Port 233f84ff-dc41-412a-921b-4b701aa6e0c9 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=233f84ff-dc41-412a-921b-4b701aa6e0c9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=233f84ff-dc41-412a-921b-4b701aa6e0c9,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=233f84ff-dc41-412a-921b-4b701aa6e0c9,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:45:54.151989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-141f31cc-b156-42bb-bc8b-7236f6e2cffb None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (233f84ff-dc41-412a-921b-4b701aa6e0c9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:54.484992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:253 started Sep 30 09:45:54.488002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0366,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=987000000,duration_sec=512,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:54.488715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:54.489618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:253 - starting polling. Elapsed:0.005 Sep 30 09:45:54.491589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:54.493841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:253 - port information retrieved. Elapsed:0.009 Sep 30 09:45:54.494420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978', '3291eabc-8476-48e1-90b3-0e49bcde606a', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'c147afeb-a580-4f58-9be3-0d2e0482431c', '0a907ef6-0733-4f96-9909-bd47d7e38800'}, 'added': {'3291eabc-8476-48e1-90b3-0e49bcde606a', 'c147afeb-a580-4f58-9be3-0d2e0482431c'}, 'removed': set(), 'updated': {'c147afeb-a580-4f58-9be3-0d2e0482431c', '3291eabc-8476-48e1-90b3-0e49bcde606a'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:45:54.497368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '3291eabc-8476-48e1-90b3-0e49bcde606a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d038a068-f643-497f-8e6f-7d6e8fb5892b', 'network_id': 'd038a068-f643-497f-8e6f-7d6e8fb5892b', 'port_id': '3291eabc-8476-48e1-90b3-0e49bcde606a', 'mac_address': 'fa:16:3e:ba:74:cd', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 392, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f2733e7-5dbc-4e5f-b1d7-072b1b8aee4d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:45:54.500963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'c147afeb-a580-4f58-9be3-0d2e0482431c', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3', 'network_id': '5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3', 'port_id': 'c147afeb-a580-4f58-9be3-0d2e0482431c', 'mac_address': 'fa:16:3e:ca:5f:df', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '60a86eb6-daf2-49f6-a6fa-6f3fdc65436e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:45:54.506076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 3291eabc-8476-48e1-90b3-0e49bcde606a {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:45:54.518789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 3291eabc-8476-48e1-90b3-0e49bcde606a updated. Details: {'device': '3291eabc-8476-48e1-90b3-0e49bcde606a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d038a068-f643-497f-8e6f-7d6e8fb5892b', 'network_id': 'd038a068-f643-497f-8e6f-7d6e8fb5892b', 'port_id': '3291eabc-8476-48e1-90b3-0e49bcde606a', 'mac_address': 'fa:16:3e:ba:74:cd', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 392, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f2733e7-5dbc-4e5f-b1d7-072b1b8aee4d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:45:54.520486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 5 as local vlan for net-id=d038a068-f643-497f-8e6f-7d6e8fb5892b, seg-id=392 Sep 30 09:45:54.536990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xc9105eec,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4488), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:54.543564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xf1c0368,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4101)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4488}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:54.545164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap3291eabc-84, col_values=(('tag', 5),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:54.545919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap3291eabc-84, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:54.546575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap3291eabc-84, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:54.600729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap3291eabc-84, col_values=(('other_config', {'net_uuid': 'd038a068-f643-497f-8e6f-7d6e8fb5892b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '392'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:54.632848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c036a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:54.633192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: c147afeb-a580-4f58-9be3-0d2e0482431c {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:45:54.633538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port c147afeb-a580-4f58-9be3-0d2e0482431c updated. Details: {'device': 'c147afeb-a580-4f58-9be3-0d2e0482431c', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3', 'network_id': '5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3', 'port_id': 'c147afeb-a580-4f58-9be3-0d2e0482431c', 'mac_address': 'fa:16:3e:ca:5f:df', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '60a86eb6-daf2-49f6-a6fa-6f3fdc65436e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:45:54.633870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 6 as local vlan for net-id=5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3, seg-id=366 Sep 30 09:45:54.637539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xc9105eee,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4462), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:54.650878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xf1c036c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4102)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4462}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:54.650878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc147afeb-a5, col_values=(('tag', 6),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:54.650878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapc147afeb-a5, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:54.650878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapc147afeb-a5, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:54.664301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc147afeb-a5, col_values=(('other_config', {'net_uuid': '5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '366'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:54.688608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c036e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:54.690399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:253 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 7 devices currently available. Time elapsed: 0.194 Sep 30 09:45:54.691143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 2 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:45:54.692249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'3291eabc-8476-48e1-90b3-0e49bcde606a', 'c147afeb-a580-4f58-9be3-0d2e0482431c'} Sep 30 09:45:54.699902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:45:54.700192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:45:54.704332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:45:54.802566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c743138-2806-4ba3-a1e9-24a7f69a95b3]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:45:54.803496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:253 - agent port security group processed in 0.309 Sep 30 09:45:54.804701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 3291eabc-8476-48e1-90b3-0e49bcde606a to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:45:54.805200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for c147afeb-a580-4f58-9be3-0d2e0482431c to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:45:54.815421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-769b198f-3e88-4406-8f1b-e6534cceb9c2 admin admin] Received resource Port update without any changes: c1feeb13-170b-4980-9c93-30ea7a94b340 {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 30 09:45:55.302063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f36e1dce-c17b-43ae-9c90-ee5368163ac1","insert","qr-c1feeb13-17",["set",[]],["map",[["attached-mac","fa:16:3e:c3:56:a6"],["iface-id","c1feeb13-170b-4980-9c93-30ea7a94b340"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:45:55.319502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f36e1dce-c17b-43ae-9c90-ee5368163ac1","old",null,["set",[]],null],["","new","qr-c1feeb13-17",9,["map",[["attached-mac","fa:16:3e:c3:56:a6"],["iface-id","c1feeb13-170b-4980-9c93-30ea7a94b340"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:45:56.313695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3626d79b-ba62-4e2a-8494-0c2e1f6ad802","insert","qg-233f84ff-dc",["set",[]],["map",[["attached-mac","fa:16:3e:84:bb:3b"],["iface-id","233f84ff-dc41-412a-921b-4b701aa6e0c9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:45:56.313695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3626d79b-ba62-4e2a-8494-0c2e1f6ad802","old",null,["set",[]],null],["","new","qg-233f84ff-dc",10,["map",[["attached-mac","fa:16:3e:84:bb:3b"],["iface-id","233f84ff-dc41-412a-921b-4b701aa6e0c9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:45:56.842155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-195b93f8-cbc5-4a50-9aa5-993527ec042c admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:45:55Z,data_plane_status=None,description='',device_id='b7ac0da4-bd4a-40ed-a8fb-31ade94ecb43',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0edf3085-2343-477c-aeff-24dca5130af3,mac_address=fa:16:3e:fb:32:4a,name='',network_id=5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3,numa_affinity_policy=,project_id='b7f6b7ca2f3b4c20ab58940f7e24c1ed',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0edf3085-2343-477c-aeff-24dca5130af3),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:45:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:56.842555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-195b93f8-cbc5-4a50-9aa5-993527ec042c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0edf3085-2343-477c-aeff-24dca5130af3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:57.162888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port 3291eabc-8476-48e1-90b3-0e49bcde606a updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:45:57.162888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3291eabc-8476-48e1-90b3-0e49bcde606a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:57.444362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['3291eabc-8476-48e1-90b3-0e49bcde606a', 'c147afeb-a580-4f58-9be3-0d2e0482431c'] and devices down [] completed. Sep 30 09:45:57.446147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:253 - ports processed. Elapsed:2.961 Sep 30 09:45:57.446892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:253 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 2, 'removed': 0}}. Elapsed:2.962 Sep 30 09:45:57.447642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Loop iteration exceeded interval (2 vs. 2.9616644382476807)! {{(pid=114230) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 30 09:45:57.447933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:254 started Sep 30 09:45:57.475677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0370,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=974000000,duration_sec=515,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:57.480121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:45:57.482130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:254 - starting polling. Elapsed:0.033 Sep 30 09:45:57.492030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:57.495899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:254 - port information retrieved. Elapsed:0.048 Sep 30 09:45:57.501329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', 'c147afeb-a580-4f58-9be3-0d2e0482431c', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': {'c1feeb13-170b-4980-9c93-30ea7a94b340', '233f84ff-dc41-412a-921b-4b701aa6e0c9'}, 'removed': set(), 'updated': {'3291eabc-8476-48e1-90b3-0e49bcde606a'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:45:57.508150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '3291eabc-8476-48e1-90b3-0e49bcde606a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d038a068-f643-497f-8e6f-7d6e8fb5892b', 'network_id': 'd038a068-f643-497f-8e6f-7d6e8fb5892b', 'port_id': '3291eabc-8476-48e1-90b3-0e49bcde606a', 'mac_address': 'fa:16:3e:ba:74:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 392, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f2733e7-5dbc-4e5f-b1d7-072b1b8aee4d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:45:57.510108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: WARNING neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:45:52Z,data_plane_status=None,description='',device_id='b196b2b1-9467-425b-85bb-6d6c105b12be',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c1feeb13-170b-4980-9c93-30ea7a94b340,mac_address=fa:16:3e:c3:56:a6,name='',network_id=069f8527-f158-4f06-809a-7a507bf3fc84,numa_affinity_policy=,project_id='f1c0948ddb014e6f93d6069bb5203890',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(c1feeb13-170b-4980-9c93-30ea7a94b340),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:45:54Z) is not bound. Sep 30 09:45:57.510967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '233f84ff-dc41-412a-921b-4b701aa6e0c9', 'device_id': 'b196b2b1-9467-425b-85bb-6d6c105b12be', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '233f84ff-dc41-412a-921b-4b701aa6e0c9', 'mac_address': 'fa:16:3e:84:bb:3b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.218'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:45:57.518971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 3291eabc-8476-48e1-90b3-0e49bcde606a {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:45:57.519591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 3291eabc-8476-48e1-90b3-0e49bcde606a updated. Details: {'device': '3291eabc-8476-48e1-90b3-0e49bcde606a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-d038a068-f643-497f-8e6f-7d6e8fb5892b', 'network_id': 'd038a068-f643-497f-8e6f-7d6e8fb5892b', 'port_id': '3291eabc-8476-48e1-90b3-0e49bcde606a', 'mac_address': 'fa:16:3e:ba:74:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 392, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f2733e7-5dbc-4e5f-b1d7-072b1b8aee4d', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Sep 30 09:45:57.524559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap3291eabc-84, col_values=(('tag', 5),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:57.525750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap3291eabc-84, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:57.527088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap3291eabc-84, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:57.529102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:45:57.533972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap3291eabc-84, col_values=(('other_config', {'net_uuid': 'd038a068-f643-497f-8e6f-7d6e8fb5892b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '392', 'tag': '5'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:57.536566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:45:57.545036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0372,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:57.546938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: c1feeb13-170b-4980-9c93-30ea7a94b340 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:45:57.547669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Device c1feeb13-170b-4980-9c93-30ea7a94b340 not defined on plugin or binding failed Sep 30 09:45:57.549252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 233f84ff-dc41-412a-921b-4b701aa6e0c9 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:45:57.556629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 233f84ff-dc41-412a-921b-4b701aa6e0c9 updated. Details: {'device': '233f84ff-dc41-412a-921b-4b701aa6e0c9', 'device_id': 'b196b2b1-9467-425b-85bb-6d6c105b12be', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '233f84ff-dc41-412a-921b-4b701aa6e0c9', 'mac_address': 'fa:16:3e:84:bb:3b', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.218'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:45:57.560855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-233f84ff-dc, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:57.564084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-233f84ff-dc, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:57.564940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-233f84ff-dc, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:57.590316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-233f84ff-dc, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:45:57.630020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0374,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:45:57.634064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:254 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 9 devices currently available. Time elapsed: 0.129 Sep 30 09:45:57.635355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 2 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:45:57.635735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'c1feeb13-170b-4980-9c93-30ea7a94b340', '233f84ff-dc41-412a-921b-4b701aa6e0c9'} Sep 30 09:45:57.646182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:45:57.647864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:45:57.683575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port c147afeb-a580-4f58-9be3-0d2e0482431c updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:45:57.684064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c147afeb-a580-4f58-9be3-0d2e0482431c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:57.695131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:45:57.712784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-885c7e53-1256-45ba-97a4-547bc0ba1e10 None None] Resource Port a814a09a-4d8f-4407-894b-fc4aa5feb85d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=a814a09a-4d8f-4407-894b-fc4aa5feb85d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a814a09a-4d8f-4407-894b-fc4aa5feb85d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:45:57.714146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-885c7e53-1256-45ba-97a4-547bc0ba1e10 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (a814a09a-4d8f-4407-894b-fc4aa5feb85d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:57.823073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6bfccc-d845-4f3f-930a-280ffa274960]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:45:57.823698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:45:57.824176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:45:57.825513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:45:57.826031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:45:57.830170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:45:57.923160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e084bc-44c0-489d-9426-e2063d6e8dca]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:45:57.938045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:254 - agent port security group processed in 0.423 Sep 30 09:45:57.938045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 3291eabc-8476-48e1-90b3-0e49bcde606a to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:45:57.938045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 233f84ff-dc41-412a-921b-4b701aa6e0c9 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:45:58.075444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-89efefb9-eb08-4cd9-a2d7-cc3fc05cb620 None None] Resource Port 52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:45:58.075995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-89efefb9-eb08-4cd9-a2d7-cc3fc05cb620 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:58.126947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-885c7e53-1256-45ba-97a4-547bc0ba1e10 None None] Resource Port a814a09a-4d8f-4407-894b-fc4aa5feb85d updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a814a09a-4d8f-4407-894b-fc4aa5feb85d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a814a09a-4d8f-4407-894b-fc4aa5feb85d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a814a09a-4d8f-4407-894b-fc4aa5feb85d,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:45:58.127804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-885c7e53-1256-45ba-97a4-547bc0ba1e10 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (a814a09a-4d8f-4407-894b-fc4aa5feb85d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:58.276509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:45:57Z,description='Default security group',id=8ce2d14e-6e01-469d-bdf8-64233135c586,is_default=True,name='default',project_id='66fd4af7b1ba4f02bd6525daa760b783',revision_number=1,rules=[SecurityGroupRule(0dcb69dc-241f-43cb-b506-c51dc25c4813),SecurityGroupRule(942b082f-f5a7-48e5-b7c3-cbe3c8a70f43),SecurityGroupRule(aba74110-a1fe-48ef-91e0-cfe0b34d11fb),SecurityGroupRule(cb630c50-71be-417e-924b-4b1e67781b42)],shared=False,stateful=True,updated_at=2022-09-30T09:45:57Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:58.282464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (8ce2d14e-6e01-469d-bdf8-64233135c586), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:58.282464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:57Z,description=,direction='egress',ethertype='IPv4',id=0dcb69dc-241f-43cb-b506-c51dc25c4813,normalized_cidr=None,port_range_max=,port_range_min=,project_id='66fd4af7b1ba4f02bd6525daa760b783',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8ce2d14e-6e01-469d-bdf8-64233135c586,updated_at=2022-09-30T09:45:57Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:58.282464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (0dcb69dc-241f-43cb-b506-c51dc25c4813), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:58.282464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Security group rule updated ['8ce2d14e-6e01-469d-bdf8-64233135c586'] Sep 30 09:45:58.282864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:57Z,description=,direction='ingress',ethertype='IPv6',id=942b082f-f5a7-48e5-b7c3-cbe3c8a70f43,normalized_cidr=None,port_range_max=,port_range_min=,project_id='66fd4af7b1ba4f02bd6525daa760b783',protocol=,remote_address_group_id=,remote_group_id=8ce2d14e-6e01-469d-bdf8-64233135c586,remote_ip_prefix=,revision_number=0,security_group_id=8ce2d14e-6e01-469d-bdf8-64233135c586,updated_at=2022-09-30T09:45:57Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:58.282864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (942b082f-f5a7-48e5-b7c3-cbe3c8a70f43), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:58.282864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Security group rule updated ['8ce2d14e-6e01-469d-bdf8-64233135c586'] Sep 30 09:45:58.285247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:57Z,description=,direction='egress',ethertype='IPv6',id=aba74110-a1fe-48ef-91e0-cfe0b34d11fb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='66fd4af7b1ba4f02bd6525daa760b783',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8ce2d14e-6e01-469d-bdf8-64233135c586,updated_at=2022-09-30T09:45:57Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:58.286971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (aba74110-a1fe-48ef-91e0-cfe0b34d11fb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:58.287906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Security group rule updated ['8ce2d14e-6e01-469d-bdf8-64233135c586'] Sep 30 09:45:58.291684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:45:57Z,description=,direction='ingress',ethertype='IPv4',id=cb630c50-71be-417e-924b-4b1e67781b42,normalized_cidr=None,port_range_max=,port_range_min=,project_id='66fd4af7b1ba4f02bd6525daa760b783',protocol=,remote_address_group_id=,remote_group_id=8ce2d14e-6e01-469d-bdf8-64233135c586,remote_ip_prefix=,revision_number=0,security_group_id=8ce2d14e-6e01-469d-bdf8-64233135c586,updated_at=2022-09-30T09:45:57Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:58.292546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (cb630c50-71be-417e-924b-4b1e67781b42), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:58.294729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dcdb9183-ee05-4646-be7d-7293c9313d01 admin admin] Security group rule updated ['8ce2d14e-6e01-469d-bdf8-64233135c586'] Sep 30 09:45:58.825613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-195b93f8-cbc5-4a50-9aa5-993527ec042c admin admin] Received resource Port update without any changes: 0edf3085-2343-477c-aeff-24dca5130af3 {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 30 09:45:58.888183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-89efefb9-eb08-4cd9-a2d7-cc3fc05cb620 None None] Resource Port 52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:45:58.888575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-89efefb9-eb08-4cd9-a2d7-cc3fc05cb620 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:59.044140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-26b778c7-41ca-4a07-b775-2a26f139d1de admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:45:57Z,data_plane_status=None,description='',device_id='cdd64d18-309c-47c2-a505-81317a69bcb9',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7e5680a6-21b5-4615-b9b3-c87cec4453e7,mac_address=fa:16:3e:59:a9:c5,name='',network_id=d038a068-f643-497f-8e6f-7d6e8fb5892b,numa_affinity_policy=,project_id='86e6b0501cb94028be07bddd2182638b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7e5680a6-21b5-4615-b9b3-c87cec4453e7),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:45:58Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:45:59.044589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-26b778c7-41ca-4a07-b775-2a26f139d1de admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (7e5680a6-21b5-4615-b9b3-c87cec4453e7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:59.181935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0b6c23fc-8389-4970-9715-0124cc52b79c","insert","qg-a814a09a-4d",["set",[]],["map",[["attached-mac","fa:16:3e:f9:c2:fe"],["iface-id","a814a09a-4d8f-4407-894b-fc4aa5feb85d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:45:59.209428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0b6c23fc-8389-4970-9715-0124cc52b79c","old",null,["set",[]],null],["","new","qg-a814a09a-4d",11,["map",[["attached-mac","fa:16:3e:f9:c2:fe"],["iface-id","a814a09a-4d8f-4407-894b-fc4aa5feb85d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:45:59.270267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Resource SecurityGroup deleted: 8ce2d14e-6e01-469d-bdf8-64233135c586 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:45:59.270267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (8ce2d14e-6e01-469d-bdf8-64233135c586), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:59.270805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8ce2d14e-6e01-469d-bdf8-64233135c586',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:45:59.662757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8ce2d14e-6e01-469d-bdf8-64233135c586',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:45:59.663829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Resource SecurityGroupRule deleted: 0dcb69dc-241f-43cb-b506-c51dc25c4813 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:45:59.664498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (0dcb69dc-241f-43cb-b506-c51dc25c4813), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:59.666073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Security group rule updated ['8ce2d14e-6e01-469d-bdf8-64233135c586'] Sep 30 09:45:59.666558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Resource SecurityGroupRule deleted: 942b082f-f5a7-48e5-b7c3-cbe3c8a70f43 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:45:59.666944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (942b082f-f5a7-48e5-b7c3-cbe3c8a70f43), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:59.667275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Security group rule updated ['8ce2d14e-6e01-469d-bdf8-64233135c586'] Sep 30 09:45:59.667657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Resource SecurityGroupRule deleted: aba74110-a1fe-48ef-91e0-cfe0b34d11fb {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:45:59.669725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (aba74110-a1fe-48ef-91e0-cfe0b34d11fb), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:59.670073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Security group rule updated ['8ce2d14e-6e01-469d-bdf8-64233135c586'] Sep 30 09:45:59.672740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Resource SecurityGroupRule deleted: cb630c50-71be-417e-924b-4b1e67781b42 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:45:59.673929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (cb630c50-71be-417e-924b-4b1e67781b42), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:45:59.675427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3e369028-6239-4dd5-93a1-375c1a31611f admin admin] Security group rule updated ['8ce2d14e-6e01-469d-bdf8-64233135c586'] Sep 30 09:46:00.421406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-26b778c7-41ca-4a07-b775-2a26f139d1de admin admin] Received resource Port update without any changes: 7e5680a6-21b5-4615-b9b3-c87cec4453e7 {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 30 09:46:00.467648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['3291eabc-8476-48e1-90b3-0e49bcde606a', '233f84ff-dc41-412a-921b-4b701aa6e0c9'] and devices down [] completed. Sep 30 09:46:00.467973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:254 - ports processed. Elapsed:3.020 Sep 30 09:46:00.469301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:254 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 1, 'removed': 0}}. Elapsed:3.020 Sep 30 09:46:00.469769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Loop iteration exceeded interval (2 vs. 3.0203628540039062)! {{(pid=114230) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 30 09:46:00.470063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:255 started Sep 30 09:46:00.473517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0376,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=972000000,duration_sec=518,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:00.474119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:00.474807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:255 - starting polling. Elapsed:0.005 Sep 30 09:46:00.477608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:00.485163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:255 - port information retrieved. Elapsed:0.015 Sep 30 09:46:00.487989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', 'c147afeb-a580-4f58-9be3-0d2e0482431c', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': {'a814a09a-4d8f-4407-894b-fc4aa5feb85d'}, 'removed': set(), 'updated': {'c147afeb-a580-4f58-9be3-0d2e0482431c', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:46:00.490057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'c147afeb-a580-4f58-9be3-0d2e0482431c', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3', 'network_id': '5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3', 'port_id': 'c147afeb-a580-4f58-9be3-0d2e0482431c', 'mac_address': 'fa:16:3e:ca:5f:df', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '60a86eb6-daf2-49f6-a6fa-6f3fdc65436e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:46:00.493403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', 'device_id': 'cdd64d18-309c-47c2-a505-81317a69bcb9', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', 'mac_address': 'fa:16:3e:f9:c2:fe', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.113'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:46:00.513911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: c147afeb-a580-4f58-9be3-0d2e0482431c {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:46:00.514183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port c147afeb-a580-4f58-9be3-0d2e0482431c updated. Details: {'device': 'c147afeb-a580-4f58-9be3-0d2e0482431c', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3', 'network_id': '5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3', 'port_id': 'c147afeb-a580-4f58-9be3-0d2e0482431c', 'mac_address': 'fa:16:3e:ca:5f:df', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '60a86eb6-daf2-49f6-a6fa-6f3fdc65436e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Sep 30 09:46:00.518631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc147afeb-a5, col_values=(('tag', 6),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:00.521440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapc147afeb-a5, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:00.522614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapc147afeb-a5, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:00.523982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:46:00.535041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapc147afeb-a5, col_values=(('other_config', {'net_uuid': '5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '366', 'tag': '6'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:00.537137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:46:00.542645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0378,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:00.544034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: a814a09a-4d8f-4407-894b-fc4aa5feb85d {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:46:00.544595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port a814a09a-4d8f-4407-894b-fc4aa5feb85d updated. Details: {'device': 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', 'device_id': 'cdd64d18-309c-47c2-a505-81317a69bcb9', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', 'mac_address': 'fa:16:3e:f9:c2:fe', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.113'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:46:00.546507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a814a09a-4d, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:00.547636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-a814a09a-4d, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:00.549068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-a814a09a-4d, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:00.567184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a814a09a-4d, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:00.584475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c037a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:00.584475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:255 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 10 devices currently available. Time elapsed: 0.093 Sep 30 09:46:00.584475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:46:00.584475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'a814a09a-4d8f-4407-894b-fc4aa5feb85d'} Sep 30 09:46:00.587148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:46:00.587812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:46:00.598525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f5cb5162-8d60-4a62-a5a5-62b5b6f18bea","insert","qr-0edf3085-23",["set",[]],["map",[["attached-mac","fa:16:3e:fb:32:4a"],["iface-id","0edf3085-2343-477c-aeff-24dca5130af3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:46:00.618362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:46:00.626408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f5cb5162-8d60-4a62-a5a5-62b5b6f18bea","old",null,["set",[]],null],["","new","qr-0edf3085-23",12,["map",[["attached-mac","fa:16:3e:fb:32:4a"],["iface-id","0edf3085-2343-477c-aeff-24dca5130af3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:46:00.769189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[011ca378-cab5-4981-9c68-46726c3e32b4]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:46:00.769879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:46:00.770189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:46:00.772031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:46:00.772031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:46:00.775515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:46:00.936324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f169ba48-5ebd-4806-8d69-3a27ae36feda]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:46:00.937655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:255 - agent port security group processed in 0.448 Sep 30 09:46:00.939581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for c147afeb-a580-4f58-9be3-0d2e0482431c to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:46:00.944007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for a814a09a-4d8f-4407-894b-fc4aa5feb85d to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:46:01.141641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port 233f84ff-dc41-412a-921b-4b701aa6e0c9 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=233f84ff-dc41-412a-921b-4b701aa6e0c9,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=233f84ff-dc41-412a-921b-4b701aa6e0c9,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:01.142473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (233f84ff-dc41-412a-921b-4b701aa6e0c9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:01.466862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:00Z,description='Default security group',id=56887242-682b-43aa-be5a-572718e01363,is_default=True,name='default',project_id='09d3e6a988c14b7e860b96d58901271a',revision_number=1,rules=[SecurityGroupRule(0849d023-7274-480f-ab01-166020f5461e),SecurityGroupRule(0c906b74-372f-4184-8815-2d4c26cefb62),SecurityGroupRule(8c7f8421-198f-49eb-91c0-a02cb5fa825e),SecurityGroupRule(c6faad17-eeb6-4f89-b096-b85d95ef43f7)],shared=False,stateful=True,updated_at=2022-09-30T09:46:00Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:01.471464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (56887242-682b-43aa-be5a-572718e01363), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:01.471464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:00Z,description=,direction='ingress',ethertype='IPv6',id=0849d023-7274-480f-ab01-166020f5461e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='09d3e6a988c14b7e860b96d58901271a',protocol=,remote_address_group_id=,remote_group_id=56887242-682b-43aa-be5a-572718e01363,remote_ip_prefix=,revision_number=0,security_group_id=56887242-682b-43aa-be5a-572718e01363,updated_at=2022-09-30T09:46:00Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:01.471464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (0849d023-7274-480f-ab01-166020f5461e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:01.471464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Security group rule updated ['56887242-682b-43aa-be5a-572718e01363'] Sep 30 09:46:01.471797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:00Z,description=,direction='ingress',ethertype='IPv4',id=0c906b74-372f-4184-8815-2d4c26cefb62,normalized_cidr=None,port_range_max=,port_range_min=,project_id='09d3e6a988c14b7e860b96d58901271a',protocol=,remote_address_group_id=,remote_group_id=56887242-682b-43aa-be5a-572718e01363,remote_ip_prefix=,revision_number=0,security_group_id=56887242-682b-43aa-be5a-572718e01363,updated_at=2022-09-30T09:46:00Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:01.471797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (0c906b74-372f-4184-8815-2d4c26cefb62), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:01.472178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Security group rule updated ['56887242-682b-43aa-be5a-572718e01363'] Sep 30 09:46:01.472731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:00Z,description=,direction='egress',ethertype='IPv4',id=8c7f8421-198f-49eb-91c0-a02cb5fa825e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='09d3e6a988c14b7e860b96d58901271a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=56887242-682b-43aa-be5a-572718e01363,updated_at=2022-09-30T09:46:00Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:01.473085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8c7f8421-198f-49eb-91c0-a02cb5fa825e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:01.473410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Security group rule updated ['56887242-682b-43aa-be5a-572718e01363'] Sep 30 09:46:01.474063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:00Z,description=,direction='egress',ethertype='IPv6',id=c6faad17-eeb6-4f89-b096-b85d95ef43f7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='09d3e6a988c14b7e860b96d58901271a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=56887242-682b-43aa-be5a-572718e01363,updated_at=2022-09-30T09:46:00Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:01.474414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c6faad17-eeb6-4f89-b096-b85d95ef43f7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:01.487375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b7ad998b-b591-43ea-a2f3-7ff4e91b0dfc admin admin] Security group rule updated ['56887242-682b-43aa-be5a-572718e01363'] Sep 30 09:46:01.771182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["553964b7-60f5-4345-92f6-540740611878","insert","qg-52ee2a7a-6d",["set",[]],["map",[["attached-mac","fa:16:3e:73:ee:49"],["iface-id","52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:46:01.798213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["553964b7-60f5-4345-92f6-540740611878","old",null,["set",[]],null],["","new","qg-52ee2a7a-6d",13,["map",[["attached-mac","fa:16:3e:73:ee:49"],["iface-id","52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:46:02.010293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Resource SecurityGroup deleted: 56887242-682b-43aa-be5a-572718e01363 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:02.012405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (56887242-682b-43aa-be5a-572718e01363), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.016879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('56887242-682b-43aa-be5a-572718e01363',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:02.099350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('56887242-682b-43aa-be5a-572718e01363',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:02.099815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Resource SecurityGroupRule deleted: 0849d023-7274-480f-ab01-166020f5461e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:02.100215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (0849d023-7274-480f-ab01-166020f5461e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.100554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Security group rule updated ['56887242-682b-43aa-be5a-572718e01363'] Sep 30 09:46:02.101122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Resource SecurityGroupRule deleted: 0c906b74-372f-4184-8815-2d4c26cefb62 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:02.101472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (0c906b74-372f-4184-8815-2d4c26cefb62), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.101795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Security group rule updated ['56887242-682b-43aa-be5a-572718e01363'] Sep 30 09:46:02.102171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Resource SecurityGroupRule deleted: 8c7f8421-198f-49eb-91c0-a02cb5fa825e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:02.103230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8c7f8421-198f-49eb-91c0-a02cb5fa825e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.103657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Security group rule updated ['56887242-682b-43aa-be5a-572718e01363'] Sep 30 09:46:02.104038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Resource SecurityGroupRule deleted: c6faad17-eeb6-4f89-b096-b85d95ef43f7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:02.104387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c6faad17-eeb6-4f89-b096-b85d95ef43f7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.104884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-efb530d7-8b88-4c2d-b34f-550edc5c21b4 admin admin] Security group rule updated ['56887242-682b-43aa-be5a-572718e01363'] Sep 30 09:46:02.421940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['c147afeb-a580-4f58-9be3-0d2e0482431c', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d'] and devices down [] completed. Sep 30 09:46:02.421940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:255 - ports processed. Elapsed:1.890 Sep 30 09:46:02.421940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:255 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:1.890 Sep 30 09:46:02.421940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:02Z,description='Default security group',id=3655b399-111e-4ee6-a8bd-6c2d06d81c54,is_default=True,name='default',project_id='15f01216eb594d88b37cb4377de3b831',revision_number=1,rules=[SecurityGroupRule(7d226f5d-3835-4849-9529-7cd26be9e01d),SecurityGroupRule(b5f8f2fd-b551-4787-bd8b-6ab89d22a44f),SecurityGroupRule(bf4aff6e-3ea2-4c02-9caf-e659d0b93ce9),SecurityGroupRule(f8fe3d90-d6d7-4895-831c-d811643c397e)],shared=False,stateful=True,updated_at=2022-09-30T09:46:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:02.423872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (3655b399-111e-4ee6-a8bd-6c2d06d81c54), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.423872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:02Z,description=,direction='ingress',ethertype='IPv4',id=7d226f5d-3835-4849-9529-7cd26be9e01d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='15f01216eb594d88b37cb4377de3b831',protocol=,remote_address_group_id=,remote_group_id=3655b399-111e-4ee6-a8bd-6c2d06d81c54,remote_ip_prefix=,revision_number=0,security_group_id=3655b399-111e-4ee6-a8bd-6c2d06d81c54,updated_at=2022-09-30T09:46:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:02.423872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7d226f5d-3835-4849-9529-7cd26be9e01d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.423872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Security group rule updated ['3655b399-111e-4ee6-a8bd-6c2d06d81c54'] Sep 30 09:46:02.424828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:02Z,description=,direction='egress',ethertype='IPv6',id=b5f8f2fd-b551-4787-bd8b-6ab89d22a44f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='15f01216eb594d88b37cb4377de3b831',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3655b399-111e-4ee6-a8bd-6c2d06d81c54,updated_at=2022-09-30T09:46:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:02.424828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b5f8f2fd-b551-4787-bd8b-6ab89d22a44f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.424828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Security group rule updated ['3655b399-111e-4ee6-a8bd-6c2d06d81c54'] Sep 30 09:46:02.425514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:02Z,description=,direction='egress',ethertype='IPv4',id=bf4aff6e-3ea2-4c02-9caf-e659d0b93ce9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='15f01216eb594d88b37cb4377de3b831',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=3655b399-111e-4ee6-a8bd-6c2d06d81c54,updated_at=2022-09-30T09:46:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:02.425514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (bf4aff6e-3ea2-4c02-9caf-e659d0b93ce9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.425514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Security group rule updated ['3655b399-111e-4ee6-a8bd-6c2d06d81c54'] Sep 30 09:46:02.425745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:02Z,description=,direction='ingress',ethertype='IPv6',id=f8fe3d90-d6d7-4895-831c-d811643c397e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='15f01216eb594d88b37cb4377de3b831',protocol=,remote_address_group_id=,remote_group_id=3655b399-111e-4ee6-a8bd-6c2d06d81c54,remote_ip_prefix=,revision_number=0,security_group_id=3655b399-111e-4ee6-a8bd-6c2d06d81c54,updated_at=2022-09-30T09:46:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:02.425745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f8fe3d90-d6d7-4895-831c-d811643c397e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.425745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-59c67db6-e2f7-4af8-948a-09112c1b157f admin admin] Security group rule updated ['3655b399-111e-4ee6-a8bd-6c2d06d81c54'] Sep 30 09:46:02.456162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port a814a09a-4d8f-4407-894b-fc4aa5feb85d updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a814a09a-4d8f-4407-894b-fc4aa5feb85d,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a814a09a-4d8f-4407-894b-fc4aa5feb85d,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:02.456546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (a814a09a-4d8f-4407-894b-fc4aa5feb85d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.471990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:256 started Sep 30 09:46:02.476771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c037c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=974000000,duration_sec=520,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:02.479092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:02.479956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:256 - starting polling. Elapsed:0.009 Sep 30 09:46:02.482867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.486269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:256 - port information retrieved. Elapsed:0.014 Sep 30 09:46:02.486689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac', '0edf3085-2343-477c-aeff-24dca5130af3', 'c147afeb-a580-4f58-9be3-0d2e0482431c', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': {'0edf3085-2343-477c-aeff-24dca5130af3', '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac'}, 'removed': set(), 'updated': {'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '233f84ff-dc41-412a-921b-4b701aa6e0c9'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:46:02.487429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: WARNING neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:45:55Z,data_plane_status=None,description='',device_id='b7ac0da4-bd4a-40ed-a8fb-31ade94ecb43',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0edf3085-2343-477c-aeff-24dca5130af3,mac_address=fa:16:3e:fb:32:4a,name='',network_id=5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3,numa_affinity_policy=,project_id='b7f6b7ca2f3b4c20ab58940f7e24c1ed',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(0edf3085-2343-477c-aeff-24dca5130af3),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:45:58Z) is not bound. Sep 30 09:46:02.488392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '233f84ff-dc41-412a-921b-4b701aa6e0c9', 'device_id': 'b196b2b1-9467-425b-85bb-6d6c105b12be', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '233f84ff-dc41-412a-921b-4b701aa6e0c9', 'mac_address': 'fa:16:3e:84:bb:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.218'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:46:02.489060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', 'device_id': 'cdd64d18-309c-47c2-a505-81317a69bcb9', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', 'mac_address': 'fa:16:3e:f9:c2:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.113'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:46:02.489896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac', 'device_id': 'b7ac0da4-bd4a-40ed-a8fb-31ade94ecb43', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac', 'mac_address': 'fa:16:3e:73:ee:49', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.80'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:46:02.492690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 0edf3085-2343-477c-aeff-24dca5130af3 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:46:02.493141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Device 0edf3085-2343-477c-aeff-24dca5130af3 not defined on plugin or binding failed Sep 30 09:46:02.493808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 233f84ff-dc41-412a-921b-4b701aa6e0c9 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:46:02.494270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 233f84ff-dc41-412a-921b-4b701aa6e0c9 updated. Details: {'device': '233f84ff-dc41-412a-921b-4b701aa6e0c9', 'device_id': 'b196b2b1-9467-425b-85bb-6d6c105b12be', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '233f84ff-dc41-412a-921b-4b701aa6e0c9', 'mac_address': 'fa:16:3e:84:bb:3b', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.218'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:46:02.506848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-233f84ff-dc, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:02.507571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-233f84ff-dc, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:02.508733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-233f84ff-dc, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:02.509551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:46:02.524960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-233f84ff-dc, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:02.525668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:46:02.535347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c037e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:02.535685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: a814a09a-4d8f-4407-894b-fc4aa5feb85d {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:46:02.540151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port a814a09a-4d8f-4407-894b-fc4aa5feb85d updated. Details: {'device': 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', 'device_id': 'cdd64d18-309c-47c2-a505-81317a69bcb9', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', 'mac_address': 'fa:16:3e:f9:c2:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.113'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:46:02.541474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a814a09a-4d, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:02.542075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-a814a09a-4d, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:02.542652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-a814a09a-4d, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:02.543659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:46:02.544765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a814a09a-4d, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:02.545726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:46:02.557598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0380,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:02.558129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:46:02.558907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac updated. Details: {'device': '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac', 'device_id': 'b7ac0da4-bd4a-40ed-a8fb-31ade94ecb43', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac', 'mac_address': 'fa:16:3e:73:ee:49', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.80'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:46:02.560194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-52ee2a7a-6d, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:02.560798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-52ee2a7a-6d, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:02.561556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-52ee2a7a-6d, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:02.570685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-52ee2a7a-6d, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:02.592021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0382,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:02.592021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:256 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 12 devices currently available. Time elapsed: 0.102 Sep 30 09:46:02.592021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 2 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:46:02.592021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'0edf3085-2343-477c-aeff-24dca5130af3', '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac'} Sep 30 09:46:02.592021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:46:02.592771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:46:02.599572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:46:02.668879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dac6c13-2bdb-4fad-9ac1-71d011b9a410]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:46:02.670096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 2 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:46:02.670694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:46:02.674254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:46:02.675165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:46:02.679971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:46:02.777436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42a9543-a213-4014-a24a-b872cb92ae67]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:46:02.778055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:256 - agent port security group processed in 0.291 Sep 30 09:46:02.779102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 233f84ff-dc41-412a-921b-4b701aa6e0c9 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:46:02.779561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for a814a09a-4d8f-4407-894b-fc4aa5feb85d to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:46:02.780657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:46:02.814181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Resource SecurityGroup deleted: 3655b399-111e-4ee6-a8bd-6c2d06d81c54 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:02.816128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (3655b399-111e-4ee6-a8bd-6c2d06d81c54), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.816634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('3655b399-111e-4ee6-a8bd-6c2d06d81c54',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:02.995292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('3655b399-111e-4ee6-a8bd-6c2d06d81c54',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:02.995717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Resource SecurityGroupRule deleted: 7d226f5d-3835-4849-9529-7cd26be9e01d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:02.996086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7d226f5d-3835-4849-9529-7cd26be9e01d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.996416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Security group rule updated ['3655b399-111e-4ee6-a8bd-6c2d06d81c54'] Sep 30 09:46:02.997059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Resource SecurityGroupRule deleted: b5f8f2fd-b551-4787-bd8b-6ab89d22a44f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:02.997402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b5f8f2fd-b551-4787-bd8b-6ab89d22a44f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.997717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Security group rule updated ['3655b399-111e-4ee6-a8bd-6c2d06d81c54'] Sep 30 09:46:02.998085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Resource SecurityGroupRule deleted: bf4aff6e-3ea2-4c02-9caf-e659d0b93ce9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:02.998423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (bf4aff6e-3ea2-4c02-9caf-e659d0b93ce9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.998896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Security group rule updated ['3655b399-111e-4ee6-a8bd-6c2d06d81c54'] Sep 30 09:46:02.999137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Resource SecurityGroupRule deleted: f8fe3d90-d6d7-4895-831c-d811643c397e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:02.999526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f8fe3d90-d6d7-4895-831c-d811643c397e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:02.999841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-76d64121-835c-49dc-8049-64c944c53674 admin admin] Security group rule updated ['3655b399-111e-4ee6-a8bd-6c2d06d81c54'] Sep 30 09:46:03.022115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-70529251-9aa7-4444-9788-b3098046c679 None None] Resource Port c1feeb13-170b-4980-9c93-30ea7a94b340 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=c1feeb13-170b-4980-9c93-30ea7a94b340,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c1feeb13-170b-4980-9c93-30ea7a94b340,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:03.022498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-70529251-9aa7-4444-9788-b3098046c679 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c1feeb13-170b-4980-9c93-30ea7a94b340), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:03.369125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8f3f6876-fe5c-47b8-9524-5eec0a6f5d76 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:03Z,description='tempest-description--781383429',id=2cd1a216-c2a2-4cfa-a192-c5feb95a64d5,is_default=False,name='tempest-securitygroup--1581862540',project_id='86e6b0501cb94028be07bddd2182638b',revision_number=1,rules=[SecurityGroupRule(7511811a-39fd-4139-83d5-66fca5a2c281),SecurityGroupRule(7718bfbf-332a-4871-9aa5-79178515a6ca)],shared=False,stateful=True,updated_at=2022-09-30T09:46:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:03.369516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8f3f6876-fe5c-47b8-9524-5eec0a6f5d76 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (2cd1a216-c2a2-4cfa-a192-c5feb95a64d5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:03.370153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8f3f6876-fe5c-47b8-9524-5eec0a6f5d76 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:03Z,description=,direction='egress',ethertype='IPv4',id=7511811a-39fd-4139-83d5-66fca5a2c281,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2cd1a216-c2a2-4cfa-a192-c5feb95a64d5,updated_at=2022-09-30T09:46:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:03.370516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8f3f6876-fe5c-47b8-9524-5eec0a6f5d76 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7511811a-39fd-4139-83d5-66fca5a2c281), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:03.371071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8f3f6876-fe5c-47b8-9524-5eec0a6f5d76 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['2cd1a216-c2a2-4cfa-a192-c5feb95a64d5'] Sep 30 09:46:03.372316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8f3f6876-fe5c-47b8-9524-5eec0a6f5d76 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:03Z,description=,direction='egress',ethertype='IPv6',id=7718bfbf-332a-4871-9aa5-79178515a6ca,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2cd1a216-c2a2-4cfa-a192-c5feb95a64d5,updated_at=2022-09-30T09:46:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:03.372685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8f3f6876-fe5c-47b8-9524-5eec0a6f5d76 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7718bfbf-332a-4871-9aa5-79178515a6ca), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:03.373176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8f3f6876-fe5c-47b8-9524-5eec0a6f5d76 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['2cd1a216-c2a2-4cfa-a192-c5feb95a64d5'] Sep 30 09:46:03.846311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-be9d14fb-aacd-4c77-af1d-4b60e00068e7 None None] Resource Port 7e5680a6-21b5-4615-b9b3-c87cec4453e7 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=7e5680a6-21b5-4615-b9b3-c87cec4453e7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7e5680a6-21b5-4615-b9b3-c87cec4453e7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:03.850311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-be9d14fb-aacd-4c77-af1d-4b60e00068e7 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (7e5680a6-21b5-4615-b9b3-c87cec4453e7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:03.928691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-113cec8b-6fc5-4da4-889b-9403cbd38341 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:03Z,description='',direction='ingress',ethertype='IPv4',id=ce0fab4b-7b15-43c5-ad44-178cf19fee07,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='86e6b0501cb94028be07bddd2182638b',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2cd1a216-c2a2-4cfa-a192-c5feb95a64d5,updated_at=2022-09-30T09:46:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:03.929423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-113cec8b-6fc5-4da4-889b-9403cbd38341 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (ce0fab4b-7b15-43c5-ad44-178cf19fee07), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:03.930202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-113cec8b-6fc5-4da4-889b-9403cbd38341 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['2cd1a216-c2a2-4cfa-a192-c5feb95a64d5'] Sep 30 09:46:04.429918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-70529251-9aa7-4444-9788-b3098046c679 None None] Resource Port c1feeb13-170b-4980-9c93-30ea7a94b340 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c1feeb13-170b-4980-9c93-30ea7a94b340,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c1feeb13-170b-4980-9c93-30ea7a94b340,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c1feeb13-170b-4980-9c93-30ea7a94b340,segment=NetworkSegment(fc32f094-22aa-44bb-9338-b364f7aad433),segment_id=fc32f094-22aa-44bb-9338-b364f7aad433)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:04.430687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-70529251-9aa7-4444-9788-b3098046c679 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c1feeb13-170b-4980-9c93-30ea7a94b340), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:04.476797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:04Z,description='Default security group',id=9a698cc2-0c1a-4f56-8d33-1752a6f5e2db,is_default=True,name='default',project_id='8ead447fbc024c66b835a0e1af4e746e',revision_number=1,rules=[SecurityGroupRule(274ef709-7c42-4548-98c2-52827032b971),SecurityGroupRule(299e71fe-ea49-45ea-91c4-efc79395cc01),SecurityGroupRule(a5561108-b6a3-46e0-91fa-6cc1deeb5f68),SecurityGroupRule(eef07f85-8530-4b0d-bea9-37b1780102c6)],shared=False,stateful=True,updated_at=2022-09-30T09:46:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:04.477796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (9a698cc2-0c1a-4f56-8d33-1752a6f5e2db), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:04.481480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:04Z,description=,direction='ingress',ethertype='IPv4',id=274ef709-7c42-4548-98c2-52827032b971,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ead447fbc024c66b835a0e1af4e746e',protocol=,remote_address_group_id=,remote_group_id=9a698cc2-0c1a-4f56-8d33-1752a6f5e2db,remote_ip_prefix=,revision_number=0,security_group_id=9a698cc2-0c1a-4f56-8d33-1752a6f5e2db,updated_at=2022-09-30T09:46:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:04.484395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (274ef709-7c42-4548-98c2-52827032b971), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:04.485604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Security group rule updated ['9a698cc2-0c1a-4f56-8d33-1752a6f5e2db'] Sep 30 09:46:04.493909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:04Z,description=,direction='egress',ethertype='IPv6',id=299e71fe-ea49-45ea-91c4-efc79395cc01,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ead447fbc024c66b835a0e1af4e746e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9a698cc2-0c1a-4f56-8d33-1752a6f5e2db,updated_at=2022-09-30T09:46:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:04.496194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (299e71fe-ea49-45ea-91c4-efc79395cc01), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:04.541416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Security group rule updated ['9a698cc2-0c1a-4f56-8d33-1752a6f5e2db'] Sep 30 09:46:04.542339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:04Z,description=,direction='egress',ethertype='IPv4',id=a5561108-b6a3-46e0-91fa-6cc1deeb5f68,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ead447fbc024c66b835a0e1af4e746e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9a698cc2-0c1a-4f56-8d33-1752a6f5e2db,updated_at=2022-09-30T09:46:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:04.552690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a5561108-b6a3-46e0-91fa-6cc1deeb5f68), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:04.554911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Security group rule updated ['9a698cc2-0c1a-4f56-8d33-1752a6f5e2db'] Sep 30 09:46:04.556435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:04Z,description=,direction='ingress',ethertype='IPv6',id=eef07f85-8530-4b0d-bea9-37b1780102c6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8ead447fbc024c66b835a0e1af4e746e',protocol=,remote_address_group_id=,remote_group_id=9a698cc2-0c1a-4f56-8d33-1752a6f5e2db,remote_ip_prefix=,revision_number=0,security_group_id=9a698cc2-0c1a-4f56-8d33-1752a6f5e2db,updated_at=2022-09-30T09:46:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:04.561315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (eef07f85-8530-4b0d-bea9-37b1780102c6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:04.562456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a59cdbb7-bf81-46d0-8e07-c45eec2e5d66 admin admin] Security group rule updated ['9a698cc2-0c1a-4f56-8d33-1752a6f5e2db'] Sep 30 09:46:04.605222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ddcdd6a1-e8f0-41ed-acc7-d822ea4b8640 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:04Z,description='',direction='ingress',ethertype='IPv4',id=600a8701-c3ce-448f-bedb-6c5c1c59c722,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2cd1a216-c2a2-4cfa-a192-c5feb95a64d5,updated_at=2022-09-30T09:46:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:04.605605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ddcdd6a1-e8f0-41ed-acc7-d822ea4b8640 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (600a8701-c3ce-448f-bedb-6c5c1c59c722), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:04.611921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ddcdd6a1-e8f0-41ed-acc7-d822ea4b8640 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['2cd1a216-c2a2-4cfa-a192-c5feb95a64d5'] Sep 30 09:46:04.957274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Resource SecurityGroup deleted: 9a698cc2-0c1a-4f56-8d33-1752a6f5e2db {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:04.957918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (9a698cc2-0c1a-4f56-8d33-1752a6f5e2db), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:04.958105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9a698cc2-0c1a-4f56-8d33-1752a6f5e2db',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:05.030909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-be9d14fb-aacd-4c77-af1d-4b60e00068e7 None None] Resource Port 7e5680a6-21b5-4615-b9b3-c87cec4453e7 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7e5680a6-21b5-4615-b9b3-c87cec4453e7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=7e5680a6-21b5-4615-b9b3-c87cec4453e7,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=7e5680a6-21b5-4615-b9b3-c87cec4453e7,segment=NetworkSegment(e6b17fb5-eb11-41c5-b8ac-1188c97e0520),segment_id=e6b17fb5-eb11-41c5-b8ac-1188c97e0520)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:05.031296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-be9d14fb-aacd-4c77-af1d-4b60e00068e7 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (7e5680a6-21b5-4615-b9b3-c87cec4453e7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:05.199131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9a698cc2-0c1a-4f56-8d33-1752a6f5e2db',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:05.199574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Resource SecurityGroupRule deleted: 274ef709-7c42-4548-98c2-52827032b971 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:05.199946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (274ef709-7c42-4548-98c2-52827032b971), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:05.200283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Security group rule updated ['9a698cc2-0c1a-4f56-8d33-1752a6f5e2db'] Sep 30 09:46:05.200673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Resource SecurityGroupRule deleted: 299e71fe-ea49-45ea-91c4-efc79395cc01 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:05.201038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (299e71fe-ea49-45ea-91c4-efc79395cc01), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:05.201360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Security group rule updated ['9a698cc2-0c1a-4f56-8d33-1752a6f5e2db'] Sep 30 09:46:05.201730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Resource SecurityGroupRule deleted: a5561108-b6a3-46e0-91fa-6cc1deeb5f68 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:05.202080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a5561108-b6a3-46e0-91fa-6cc1deeb5f68), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:05.202431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Security group rule updated ['9a698cc2-0c1a-4f56-8d33-1752a6f5e2db'] Sep 30 09:46:05.204973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Resource SecurityGroupRule deleted: eef07f85-8530-4b0d-bea9-37b1780102c6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:05.205357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (eef07f85-8530-4b0d-bea9-37b1780102c6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:05.205692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7d55ac0c-7083-40dd-8daf-86d2cc72e91d admin admin] Security group rule updated ['9a698cc2-0c1a-4f56-8d33-1752a6f5e2db'] Sep 30 09:46:05.688789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d55b1ef3-770e-436e-be7f-eb443611987e None None] Resource Port 7e5680a6-21b5-4615-b9b3-c87cec4453e7 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:05.689079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d55b1ef3-770e-436e-be7f-eb443611987e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (7e5680a6-21b5-4615-b9b3-c87cec4453e7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:06.033963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b1bb5e55-24f1-4298-9913-fd14b035df5a tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:46:05Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5fab9566-6968-43d0-88cc-d3c1a3c6b4ec,mac_address=fa:16:3e:cb:cd:b5,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5fab9566-6968-43d0-88cc-d3c1a3c6b4ec),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T09:46:05Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:06.035069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b1bb5e55-24f1-4298-9913-fd14b035df5a tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5fab9566-6968-43d0-88cc-d3c1a3c6b4ec), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:06.274177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['233f84ff-dc41-412a-921b-4b701aa6e0c9', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac'] and devices down [] completed. Sep 30 09:46:06.274416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:256 - ports processed. Elapsed:3.803 Sep 30 09:46:06.274789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:256 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 2, 'removed': 0}}. Elapsed:3.803 Sep 30 09:46:06.275808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Loop iteration exceeded interval (2 vs. 3.8034934997558594)! {{(pid=114230) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 30 09:46:06.276099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:257 started Sep 30 09:46:06.280135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0384,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=778000000,duration_sec=524,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:06.281385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:06.285380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:257 - starting polling. Elapsed:0.006 Sep 30 09:46:06.285380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:06.298196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:257 - port information retrieved. Elapsed:0.022 Sep 30 09:46:06.298395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac', '0edf3085-2343-477c-aeff-24dca5130af3', 'c147afeb-a580-4f58-9be3-0d2e0482431c', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': set(), 'removed': set(), 'updated': {'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:46:06.300613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'c1feeb13-170b-4980-9c93-30ea7a94b340', 'device_id': 'b196b2b1-9467-425b-85bb-6d6c105b12be', 'network_id': '069f8527-f158-4f06-809a-7a507bf3fc84', 'port_id': 'c1feeb13-170b-4980-9c93-30ea7a94b340', 'mac_address': 'fa:16:3e:c3:56:a6', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5097a34b-c136-47dd-9d48-0761ca5f7a16', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:46:06.307077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: c1feeb13-170b-4980-9c93-30ea7a94b340 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:46:06.308347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port c1feeb13-170b-4980-9c93-30ea7a94b340 updated. Details: {'device': 'c1feeb13-170b-4980-9c93-30ea7a94b340', 'device_id': 'b196b2b1-9467-425b-85bb-6d6c105b12be', 'network_id': '069f8527-f158-4f06-809a-7a507bf3fc84', 'port_id': 'c1feeb13-170b-4980-9c93-30ea7a94b340', 'mac_address': 'fa:16:3e:c3:56:a6', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5097a34b-c136-47dd-9d48-0761ca5f7a16', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Sep 30 09:46:06.308475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c1feeb13-17, col_values=(('tag', 4),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:06.308857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-c1feeb13-17, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:06.309278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-c1feeb13-17, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:06.336812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c1feeb13-17, col_values=(('other_config', {'net_uuid': '069f8527-f158-4f06-809a-7a507bf3fc84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '4', 'segmentation_id': '391'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:06.353670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0386,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:06.361034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:257 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 12 devices currently available. Time elapsed: 0.062 Sep 30 09:46:06.361568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:46:06.362002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:46:06.364568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:46:06.366145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:46:06.381392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:46:06.393812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port 52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:06.396522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:06.466479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[97206188-168b-4b0d-b438-19d7418c8489]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:46:06.467605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:257 - agent port security group processed in 0.169 Sep 30 09:46:06.468358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for c1feeb13-170b-4980-9c93-30ea7a94b340 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:46:06.741208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a4f1c8ff-1eb5-420f-a319-42aaf46a5f07","insert","qr-7e5680a6-21",["set",[]],["map",[["attached-mac","fa:16:3e:59:a9:c5"],["iface-id","7e5680a6-21b5-4615-b9b3-c87cec4453e7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:46:06.755535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a4f1c8ff-1eb5-420f-a319-42aaf46a5f07","old",null,["set",[]],null],["","new","qr-7e5680a6-21",14,["map",[["attached-mac","fa:16:3e:59:a9:c5"],["iface-id","7e5680a6-21b5-4615-b9b3-c87cec4453e7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:46:07.285941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d55b1ef3-770e-436e-be7f-eb443611987e None None] Resource Port c1feeb13-170b-4980-9c93-30ea7a94b340 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:07.286654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d55b1ef3-770e-436e-be7f-eb443611987e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c1feeb13-170b-4980-9c93-30ea7a94b340), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:07.478143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b1bb5e55-24f1-4298-9913-fd14b035df5a tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource Port 5fab9566-6968-43d0-88cc-d3c1a3c6b4ec updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'aad1fb92-e26d-40af-89c5-b7c9f40ad880'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:07.479570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b1bb5e55-24f1-4298-9913-fd14b035df5a tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5fab9566-6968-43d0-88cc-d3c1a3c6b4ec), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:08.172779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['c1feeb13-170b-4980-9c93-30ea7a94b340'] and devices down [] completed. Sep 30 09:46:08.173389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:257 - ports processed. Elapsed:1.897 Sep 30 09:46:08.173954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:257 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:1.898 Sep 30 09:46:08.278339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:258 started Sep 30 09:46:08.283312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0388,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=782000000,duration_sec=526,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:08.284171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:08.285197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:258 - starting polling. Elapsed:0.007 Sep 30 09:46:08.287880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:08.297424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:258 - port information retrieved. Elapsed:0.019 Sep 30 09:46:08.302765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac', '0edf3085-2343-477c-aeff-24dca5130af3', 'c147afeb-a580-4f58-9be3-0d2e0482431c', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': {'7e5680a6-21b5-4615-b9b3-c87cec4453e7'}, 'removed': set(), 'updated': {'c1feeb13-170b-4980-9c93-30ea7a94b340', '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:46:08.305112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'device_id': 'cdd64d18-309c-47c2-a505-81317a69bcb9', 'network_id': 'd038a068-f643-497f-8e6f-7d6e8fb5892b', 'port_id': '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'mac_address': 'fa:16:3e:59:a9:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 392, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f2733e7-5dbc-4e5f-b1d7-072b1b8aee4d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:46:08.307159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'c1feeb13-170b-4980-9c93-30ea7a94b340', 'device_id': 'b196b2b1-9467-425b-85bb-6d6c105b12be', 'network_id': '069f8527-f158-4f06-809a-7a507bf3fc84', 'port_id': 'c1feeb13-170b-4980-9c93-30ea7a94b340', 'mac_address': 'fa:16:3e:c3:56:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5097a34b-c136-47dd-9d48-0761ca5f7a16', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:46:08.309156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac', 'device_id': 'b7ac0da4-bd4a-40ed-a8fb-31ade94ecb43', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac', 'mac_address': 'fa:16:3e:73:ee:49', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.80'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:46:08.319381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 7e5680a6-21b5-4615-b9b3-c87cec4453e7 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:46:08.327675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 7e5680a6-21b5-4615-b9b3-c87cec4453e7 updated. Details: {'device': '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'device_id': 'cdd64d18-309c-47c2-a505-81317a69bcb9', 'network_id': 'd038a068-f643-497f-8e6f-7d6e8fb5892b', 'port_id': '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'mac_address': 'fa:16:3e:59:a9:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 392, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f2733e7-5dbc-4e5f-b1d7-072b1b8aee4d', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 5} Sep 30 09:46:08.330077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7e5680a6-21, col_values=(('tag', 5),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:08.332061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-7e5680a6-21, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:08.334295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-7e5680a6-21, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:08.354105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7e5680a6-21, col_values=(('other_config', {'net_uuid': 'd038a068-f643-497f-8e6f-7d6e8fb5892b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '5', 'segmentation_id': '392'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:08.397049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c038a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:08.402240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: c1feeb13-170b-4980-9c93-30ea7a94b340 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:46:08.407128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port c1feeb13-170b-4980-9c93-30ea7a94b340 updated. Details: {'device': 'c1feeb13-170b-4980-9c93-30ea7a94b340', 'device_id': 'b196b2b1-9467-425b-85bb-6d6c105b12be', 'network_id': '069f8527-f158-4f06-809a-7a507bf3fc84', 'port_id': 'c1feeb13-170b-4980-9c93-30ea7a94b340', 'mac_address': 'fa:16:3e:c3:56:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '5097a34b-c136-47dd-9d48-0761ca5f7a16', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 4} Sep 30 09:46:08.409371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c1feeb13-17, col_values=(('tag', 4),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:08.413814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-c1feeb13-17, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:08.414563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-c1feeb13-17, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:08.415263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:46:08.416347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-c1feeb13-17, col_values=(('other_config', {'net_uuid': '069f8527-f158-4f06-809a-7a507bf3fc84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '391', 'tag': '4'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:08.424344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:46:08.440030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c038c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:08.447146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:46:08.453422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac updated. Details: {'device': '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac', 'device_id': 'b7ac0da4-bd4a-40ed-a8fb-31ade94ecb43', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac', 'mac_address': 'fa:16:3e:73:ee:49', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.80'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:46:08.457526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-52ee2a7a-6d, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:08.460157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-52ee2a7a-6d, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:08.461772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-52ee2a7a-6d, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:08.464335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:46:08.467398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-52ee2a7a-6d, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:08.471875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:46:08.484820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c038e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:08.492255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:258 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.187 Sep 30 09:46:08.492961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:46:08.496373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'7e5680a6-21b5-4615-b9b3-c87cec4453e7'} Sep 30 09:46:08.498132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:46:08.500640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:46:08.523466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:46:08.622392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d67e69c-2c10-40cd-968c-4f6a78c2a86c]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:46:08.623195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 2 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:46:08.623580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:46:08.625604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:46:08.626119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:46:08.631086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:46:08.797936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef7c4f0-af02-4b50-b00e-e518064dd950]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:46:08.798959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:258 - agent port security group processed in 0.494 Sep 30 09:46:08.800014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 7e5680a6-21b5-4615-b9b3-c87cec4453e7 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:46:08.800519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for c1feeb13-170b-4980-9c93-30ea7a94b340 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:46:08.801704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:46:08.872721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-63b26104-5641-488b-b20f-6be8bcd9fd27 None None] Resource Port 0edf3085-2343-477c-aeff-24dca5130af3 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=0edf3085-2343-477c-aeff-24dca5130af3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0edf3085-2343-477c-aeff-24dca5130af3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:08.874821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-63b26104-5641-488b-b20f-6be8bcd9fd27 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0edf3085-2343-477c-aeff-24dca5130af3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:09.580853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f8124fb7-ad4b-48fc-b3fb-f142587174c9 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:46:07Z,data_plane_status=None,description='',device_id='fd8e4eb8-1261-4abf-82ec-e1d8afda21ec',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=45105b4f-28b5-44d6-bdd3-42f2c0b33de7,mac_address=fa:16:3e:5e:ca:13,name='',network_id=069f8527-f158-4f06-809a-7a507bf3fc84,numa_affinity_policy=,project_id='f1c0948ddb014e6f93d6069bb5203890',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(45105b4f-28b5-44d6-bdd3-42f2c0b33de7),security_group_ids=set([462c076e-5253-483e-b5c8-ce3514101941]),status='DOWN',updated_at=2022-09-30T09:46:08Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:09.581445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f8124fb7-ad4b-48fc-b3fb-f142587174c9 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (45105b4f-28b5-44d6-bdd3-42f2c0b33de7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:09.581666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f8124fb7-ad4b-48fc-b3fb-f142587174c9 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group member updated {'462c076e-5253-483e-b5c8-ce3514101941'} Sep 30 09:46:10.092757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-63b26104-5641-488b-b20f-6be8bcd9fd27 None None] Resource Port 0edf3085-2343-477c-aeff-24dca5130af3 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0edf3085-2343-477c-aeff-24dca5130af3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0edf3085-2343-477c-aeff-24dca5130af3,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0edf3085-2343-477c-aeff-24dca5130af3,segment=NetworkSegment(2ac308fb-7102-4667-bb4c-5798a82aae29),segment_id=2ac308fb-7102-4667-bb4c-5798a82aae29)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:10.093335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-63b26104-5641-488b-b20f-6be8bcd9fd27 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0edf3085-2343-477c-aeff-24dca5130af3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:10.838266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-118949ed-9f98-451b-b424-61e2b809af2f tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:46:08Z,data_plane_status=None,description='',device_id='d2701f34-7f9f-49cb-a2c3-9f84c1a96e31',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d3f7eb0a-905a-4efa-b08a-3fca026724aa,mac_address=fa:16:3e:a0:01:f1,name='',network_id=069f8527-f158-4f06-809a-7a507bf3fc84,numa_affinity_policy=,project_id='f1c0948ddb014e6f93d6069bb5203890',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d3f7eb0a-905a-4efa-b08a-3fca026724aa),security_group_ids=set([462c076e-5253-483e-b5c8-ce3514101941]),status='DOWN',updated_at=2022-09-30T09:46:09Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:10.840227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-118949ed-9f98-451b-b424-61e2b809af2f tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (d3f7eb0a-905a-4efa-b08a-3fca026724aa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:10.841041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-118949ed-9f98-451b-b424-61e2b809af2f tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group member updated {'462c076e-5253-483e-b5c8-ce3514101941'} Sep 30 09:46:11.374471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d55b1ef3-770e-436e-be7f-eb443611987e None None] Resource Port 0edf3085-2343-477c-aeff-24dca5130af3 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:11.383388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d55b1ef3-770e-436e-be7f-eb443611987e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0edf3085-2343-477c-aeff-24dca5130af3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:11.492535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c1de170a-2788-4404-8233-4da34f5c1b2c tempest-DeleteServersTestJSON-1102723588 tempest-DeleteServersTestJSON-1102723588-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:46:10Z,data_plane_status=None,description='',device_id='2a244aaa-c28f-405e-ad45-39386205bb41',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8588e984-7119-40f8-9e2a-800c04c4c6aa,mac_address=fa:16:3e:31:0f:aa,name='',network_id=5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3,numa_affinity_policy=,project_id='b7f6b7ca2f3b4c20ab58940f7e24c1ed',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8588e984-7119-40f8-9e2a-800c04c4c6aa),security_group_ids=set([36a8dc30-8d9a-4b94-899b-74bfa1118bd6]),status='DOWN',updated_at=2022-09-30T09:46:10Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:11.493392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c1de170a-2788-4404-8233-4da34f5c1b2c tempest-DeleteServersTestJSON-1102723588 tempest-DeleteServersTestJSON-1102723588-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (8588e984-7119-40f8-9e2a-800c04c4c6aa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:11.494505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c1de170a-2788-4404-8233-4da34f5c1b2c tempest-DeleteServersTestJSON-1102723588 tempest-DeleteServersTestJSON-1102723588-project] Security group member updated {'36a8dc30-8d9a-4b94-899b-74bfa1118bd6'} Sep 30 09:46:12.231227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac'] and devices down [] completed. Sep 30 09:46:12.231859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:258 - ports processed. Elapsed:3.953 Sep 30 09:46:12.231948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:258 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:3.954 Sep 30 09:46:12.232597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Loop iteration exceeded interval (2 vs. 3.9537065029144287)! {{(pid=114230) loop_count_and_wait /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2496}} Sep 30 09:46:12.235862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:259 started Sep 30 09:46:12.238956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0390,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=739000000,duration_sec=530,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:12.241339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:12.245437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:259 - starting polling. Elapsed:0.007 Sep 30 09:46:12.259828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:12.279812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:259 - port information retrieved. Elapsed:0.046 Sep 30 09:46:12.281184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac', '0edf3085-2343-477c-aeff-24dca5130af3', 'c147afeb-a580-4f58-9be3-0d2e0482431c', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': set(), 'removed': set(), 'updated': {'0edf3085-2343-477c-aeff-24dca5130af3'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:46:12.281979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '0edf3085-2343-477c-aeff-24dca5130af3', 'device_id': 'b7ac0da4-bd4a-40ed-a8fb-31ade94ecb43', 'network_id': '5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3', 'port_id': '0edf3085-2343-477c-aeff-24dca5130af3', 'mac_address': 'fa:16:3e:fb:32:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '60a86eb6-daf2-49f6-a6fa-6f3fdc65436e', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:46:12.285493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 0edf3085-2343-477c-aeff-24dca5130af3 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:46:12.286516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 0edf3085-2343-477c-aeff-24dca5130af3 updated. Details: {'device': '0edf3085-2343-477c-aeff-24dca5130af3', 'device_id': 'b7ac0da4-bd4a-40ed-a8fb-31ade94ecb43', 'network_id': '5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3', 'port_id': '0edf3085-2343-477c-aeff-24dca5130af3', 'mac_address': 'fa:16:3e:fb:32:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 366, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '60a86eb6-daf2-49f6-a6fa-6f3fdc65436e', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 6} Sep 30 09:46:12.288064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-0edf3085-23, col_values=(('tag', 6),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:12.288671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-0edf3085-23, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:12.289292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-0edf3085-23, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:12.299882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8b081ae7-9fe9-4d1d-89b4-4cfc1a16f5d4 service neutron] Resource Port 45105b4f-28b5-44d6-bdd3-42f2c0b33de7 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=45105b4f-28b5-44d6-bdd3-42f2c0b33de7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=45105b4f-28b5-44d6-bdd3-42f2c0b33de7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:12.300458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8b081ae7-9fe9-4d1d-89b4-4cfc1a16f5d4 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (45105b4f-28b5-44d6-bdd3-42f2c0b33de7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:12.304776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-0edf3085-23, col_values=(('other_config', {'net_uuid': '5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '6', 'segmentation_id': '366'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:46:12.314939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0392,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:12.315534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:259 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.034 Sep 30 09:46:12.316257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:46:12.316700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:46:12.318554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:46:12.319069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:46:12.323565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:46:12.440344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8de6c45-7593-411f-a0bf-6c077d58682f]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:46:12.441026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:259 - agent port security group processed in 0.159 Sep 30 09:46:12.441709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 0edf3085-2343-477c-aeff-24dca5130af3 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:46:12.658637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['0edf3085-2343-477c-aeff-24dca5130af3'] and devices down [] completed. Sep 30 09:46:12.659746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:259 - ports processed. Elapsed:0.426 Sep 30 09:46:12.660086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:259 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.427 Sep 30 09:46:12.806432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8b081ae7-9fe9-4d1d-89b4-4cfc1a16f5d4 service neutron] Resource Port 45105b4f-28b5-44d6-bdd3-42f2c0b33de7 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=45105b4f-28b5-44d6-bdd3-42f2c0b33de7,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=45105b4f-28b5-44d6-bdd3-42f2c0b33de7,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=45105b4f-28b5-44d6-bdd3-42f2c0b33de7,segment=NetworkSegment(fc32f094-22aa-44bb-9338-b364f7aad433),segment_id=fc32f094-22aa-44bb-9338-b364f7aad433)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:12.810953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8b081ae7-9fe9-4d1d-89b4-4cfc1a16f5d4 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (45105b4f-28b5-44d6-bdd3-42f2c0b33de7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:13.539679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:13Z,description='Default security group',id=861720eb-c246-4b31-88d9-29cda3ef3c28,is_default=True,name='default',project_id='c93c658159364808a249bdf8b2ccd752',revision_number=1,rules=[SecurityGroupRule(4e86b392-04b1-4d3a-84e4-35cca0c6dd8a),SecurityGroupRule(99516b92-9b3a-4a7e-8074-b93febfb34d8),SecurityGroupRule(d59ad9c5-3ed0-4f79-ae56-897e4fcebf4e),SecurityGroupRule(eedb856e-1556-4e91-a3e7-f1ffd7823041)],shared=False,stateful=True,updated_at=2022-09-30T09:46:13Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:13.540283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (861720eb-c246-4b31-88d9-29cda3ef3c28), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:13.540703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:13Z,description=,direction='ingress',ethertype='IPv4',id=4e86b392-04b1-4d3a-84e4-35cca0c6dd8a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c93c658159364808a249bdf8b2ccd752',protocol=,remote_address_group_id=,remote_group_id=861720eb-c246-4b31-88d9-29cda3ef3c28,remote_ip_prefix=,revision_number=0,security_group_id=861720eb-c246-4b31-88d9-29cda3ef3c28,updated_at=2022-09-30T09:46:13Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:13.541050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4e86b392-04b1-4d3a-84e4-35cca0c6dd8a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:13.541388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Security group rule updated ['861720eb-c246-4b31-88d9-29cda3ef3c28'] Sep 30 09:46:13.542069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:13Z,description=,direction='ingress',ethertype='IPv6',id=99516b92-9b3a-4a7e-8074-b93febfb34d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c93c658159364808a249bdf8b2ccd752',protocol=,remote_address_group_id=,remote_group_id=861720eb-c246-4b31-88d9-29cda3ef3c28,remote_ip_prefix=,revision_number=0,security_group_id=861720eb-c246-4b31-88d9-29cda3ef3c28,updated_at=2022-09-30T09:46:13Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:13.542429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (99516b92-9b3a-4a7e-8074-b93febfb34d8), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:13.542779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Security group rule updated ['861720eb-c246-4b31-88d9-29cda3ef3c28'] Sep 30 09:46:13.543449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:13Z,description=,direction='egress',ethertype='IPv6',id=d59ad9c5-3ed0-4f79-ae56-897e4fcebf4e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c93c658159364808a249bdf8b2ccd752',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=861720eb-c246-4b31-88d9-29cda3ef3c28,updated_at=2022-09-30T09:46:13Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:13.543806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d59ad9c5-3ed0-4f79-ae56-897e4fcebf4e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:13.544133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Security group rule updated ['861720eb-c246-4b31-88d9-29cda3ef3c28'] Sep 30 09:46:13.544790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:13Z,description=,direction='egress',ethertype='IPv4',id=eedb856e-1556-4e91-a3e7-f1ffd7823041,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c93c658159364808a249bdf8b2ccd752',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=861720eb-c246-4b31-88d9-29cda3ef3c28,updated_at=2022-09-30T09:46:13Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:13.545145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (eedb856e-1556-4e91-a3e7-f1ffd7823041), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:13.545545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-96a0431c-14e4-47da-8552-778384772813 admin admin] Security group rule updated ['861720eb-c246-4b31-88d9-29cda3ef3c28'] Sep 30 09:46:13.872384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Resource SecurityGroup deleted: 861720eb-c246-4b31-88d9-29cda3ef3c28 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:13.873007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (861720eb-c246-4b31-88d9-29cda3ef3c28), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:13.873494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('861720eb-c246-4b31-88d9-29cda3ef3c28',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:13.888350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('861720eb-c246-4b31-88d9-29cda3ef3c28',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:13.889608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Resource SecurityGroupRule deleted: 4e86b392-04b1-4d3a-84e4-35cca0c6dd8a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:13.889778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4e86b392-04b1-4d3a-84e4-35cca0c6dd8a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:13.890180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Security group rule updated ['861720eb-c246-4b31-88d9-29cda3ef3c28'] Sep 30 09:46:13.890571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Resource SecurityGroupRule deleted: 99516b92-9b3a-4a7e-8074-b93febfb34d8 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:13.890972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (99516b92-9b3a-4a7e-8074-b93febfb34d8), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:13.891292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Security group rule updated ['861720eb-c246-4b31-88d9-29cda3ef3c28'] Sep 30 09:46:13.891659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Resource SecurityGroupRule deleted: d59ad9c5-3ed0-4f79-ae56-897e4fcebf4e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:13.891999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d59ad9c5-3ed0-4f79-ae56-897e4fcebf4e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:13.892331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Security group rule updated ['861720eb-c246-4b31-88d9-29cda3ef3c28'] Sep 30 09:46:13.892693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Resource SecurityGroupRule deleted: eedb856e-1556-4e91-a3e7-f1ffd7823041 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:13.893052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (eedb856e-1556-4e91-a3e7-f1ffd7823041), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:13.893483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b70851fa-44c2-4831-a5ab-eccb57f971b8 admin admin] Security group rule updated ['861720eb-c246-4b31-88d9-29cda3ef3c28'] Sep 30 09:46:14.233775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:260 started Sep 30 09:46:14.236585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0394,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=736000000,duration_sec=532,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:14.237188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:14.237516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:260 - starting polling. Elapsed:0.004 Sep 30 09:46:14.239846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:14.242391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:260 - port information retrieved. Elapsed:0.009 Sep 30 09:46:14.242749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:260 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:46:15.101165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:14Z,description='Default security group',id=0cc46bed-ce50-441a-beb5-7608cb8cc833,is_default=True,name='default',project_id='dc3720bb351f43fc9ea163c42427bad6',revision_number=1,rules=[SecurityGroupRule(17a553a5-00b5-46ea-a8df-0675a3efc04a),SecurityGroupRule(44a9b71f-fa3c-413d-828e-aa57ecdfb74d),SecurityGroupRule(71cbfb04-d51e-48ae-9710-69c57b65bdfc),SecurityGroupRule(86f5d3b6-9eb2-4e71-bf80-998aac4f9603)],shared=False,stateful=True,updated_at=2022-09-30T09:46:14Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:15.101887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (0cc46bed-ce50-441a-beb5-7608cb8cc833), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:15.102118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:14Z,description=,direction='ingress',ethertype='IPv4',id=17a553a5-00b5-46ea-a8df-0675a3efc04a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dc3720bb351f43fc9ea163c42427bad6',protocol=,remote_address_group_id=,remote_group_id=0cc46bed-ce50-441a-beb5-7608cb8cc833,remote_ip_prefix=,revision_number=0,security_group_id=0cc46bed-ce50-441a-beb5-7608cb8cc833,updated_at=2022-09-30T09:46:14Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:15.102793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (17a553a5-00b5-46ea-a8df-0675a3efc04a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:15.104396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Security group rule updated ['0cc46bed-ce50-441a-beb5-7608cb8cc833'] Sep 30 09:46:15.104396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:14Z,description=,direction='egress',ethertype='IPv4',id=44a9b71f-fa3c-413d-828e-aa57ecdfb74d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dc3720bb351f43fc9ea163c42427bad6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0cc46bed-ce50-441a-beb5-7608cb8cc833,updated_at=2022-09-30T09:46:14Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:15.104396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (44a9b71f-fa3c-413d-828e-aa57ecdfb74d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:15.104657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Security group rule updated ['0cc46bed-ce50-441a-beb5-7608cb8cc833'] Sep 30 09:46:15.105189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:14Z,description=,direction='ingress',ethertype='IPv6',id=71cbfb04-d51e-48ae-9710-69c57b65bdfc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dc3720bb351f43fc9ea163c42427bad6',protocol=,remote_address_group_id=,remote_group_id=0cc46bed-ce50-441a-beb5-7608cb8cc833,remote_ip_prefix=,revision_number=0,security_group_id=0cc46bed-ce50-441a-beb5-7608cb8cc833,updated_at=2022-09-30T09:46:14Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:15.105544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (71cbfb04-d51e-48ae-9710-69c57b65bdfc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:15.105873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Security group rule updated ['0cc46bed-ce50-441a-beb5-7608cb8cc833'] Sep 30 09:46:15.109727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:14Z,description=,direction='egress',ethertype='IPv6',id=86f5d3b6-9eb2-4e71-bf80-998aac4f9603,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dc3720bb351f43fc9ea163c42427bad6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0cc46bed-ce50-441a-beb5-7608cb8cc833,updated_at=2022-09-30T09:46:14Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:15.110137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (86f5d3b6-9eb2-4e71-bf80-998aac4f9603), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:15.110480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0d19975b-38c2-4735-af4a-be9f492bf067 admin admin] Security group rule updated ['0cc46bed-ce50-441a-beb5-7608cb8cc833'] Sep 30 09:46:15.386773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Resource SecurityGroup deleted: 0cc46bed-ce50-441a-beb5-7608cb8cc833 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:15.387401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (0cc46bed-ce50-441a-beb5-7608cb8cc833), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:15.388095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0cc46bed-ce50-441a-beb5-7608cb8cc833',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:15.421043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0cc46bed-ce50-441a-beb5-7608cb8cc833',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:15.421493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Resource SecurityGroupRule deleted: 17a553a5-00b5-46ea-a8df-0675a3efc04a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:15.422353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (17a553a5-00b5-46ea-a8df-0675a3efc04a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:15.423177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Security group rule updated ['0cc46bed-ce50-441a-beb5-7608cb8cc833'] Sep 30 09:46:15.423974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Resource SecurityGroupRule deleted: 44a9b71f-fa3c-413d-828e-aa57ecdfb74d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:15.424322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (44a9b71f-fa3c-413d-828e-aa57ecdfb74d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:15.424653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Security group rule updated ['0cc46bed-ce50-441a-beb5-7608cb8cc833'] Sep 30 09:46:15.425033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Resource SecurityGroupRule deleted: 71cbfb04-d51e-48ae-9710-69c57b65bdfc {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:15.425384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (71cbfb04-d51e-48ae-9710-69c57b65bdfc), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:15.427017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Security group rule updated ['0cc46bed-ce50-441a-beb5-7608cb8cc833'] Sep 30 09:46:15.427410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Resource SecurityGroupRule deleted: 86f5d3b6-9eb2-4e71-bf80-998aac4f9603 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:15.429335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (86f5d3b6-9eb2-4e71-bf80-998aac4f9603), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:15.429335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2db67586-7d6b-4263-9486-345402ef8b35 admin admin] Security group rule updated ['0cc46bed-ce50-441a-beb5-7608cb8cc833'] Sep 30 09:46:16.234717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:261 started Sep 30 09:46:16.238821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0396,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=738000000,duration_sec=534,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:16.239660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:16.240209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:261 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:46:17.583919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a5d9422f-2555-4457-bb38-ae7f1879ade8 service neutron] Resource Port d3f7eb0a-905a-4efa-b08a-3fca026724aa updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=d3f7eb0a-905a-4efa-b08a-3fca026724aa,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=d3f7eb0a-905a-4efa-b08a-3fca026724aa,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:17.584583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a5d9422f-2555-4457-bb38-ae7f1879ade8 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (d3f7eb0a-905a-4efa-b08a-3fca026724aa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:17.700847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b0c5b794-bb3e-48ff-a333-2dc563ebe099 service neutron] Resource Port 8588e984-7119-40f8-9e2a-800c04c4c6aa updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=8588e984-7119-40f8-9e2a-800c04c4c6aa,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=8588e984-7119-40f8-9e2a-800c04c4c6aa,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:17.702199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b0c5b794-bb3e-48ff-a333-2dc563ebe099 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (8588e984-7119-40f8-9e2a-800c04c4c6aa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.109169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a5d9422f-2555-4457-bb38-ae7f1879ade8 service neutron] Resource Port d3f7eb0a-905a-4efa-b08a-3fca026724aa updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=d3f7eb0a-905a-4efa-b08a-3fca026724aa,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=d3f7eb0a-905a-4efa-b08a-3fca026724aa,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=d3f7eb0a-905a-4efa-b08a-3fca026724aa,segment=NetworkSegment(fc32f094-22aa-44bb-9338-b364f7aad433),segment_id=fc32f094-22aa-44bb-9338-b364f7aad433)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:18.109826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a5d9422f-2555-4457-bb38-ae7f1879ade8 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (d3f7eb0a-905a-4efa-b08a-3fca026724aa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.119769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:17Z,description='Default security group',id=d3c5eff9-c13d-49aa-b79e-a9828f942144,is_default=True,name='default',project_id='a8f8c0108e1d45c6984325afff2c5fe9',revision_number=1,rules=[SecurityGroupRule(16b55b9e-1f4e-4d02-a125-f856ff20cfa7),SecurityGroupRule(1bd1babc-a82f-4c46-96ee-0232b0f5363b),SecurityGroupRule(74d31c82-120d-4e6a-9e06-9c9823b406ee),SecurityGroupRule(7b62ce83-7d22-420a-a645-6ae46973e732)],shared=False,stateful=True,updated_at=2022-09-30T09:46:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:18.122413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (d3c5eff9-c13d-49aa-b79e-a9828f942144), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.124073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:17Z,description=,direction='ingress',ethertype='IPv4',id=16b55b9e-1f4e-4d02-a125-f856ff20cfa7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a8f8c0108e1d45c6984325afff2c5fe9',protocol=,remote_address_group_id=,remote_group_id=d3c5eff9-c13d-49aa-b79e-a9828f942144,remote_ip_prefix=,revision_number=0,security_group_id=d3c5eff9-c13d-49aa-b79e-a9828f942144,updated_at=2022-09-30T09:46:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:18.125444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (16b55b9e-1f4e-4d02-a125-f856ff20cfa7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.127438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Security group rule updated ['d3c5eff9-c13d-49aa-b79e-a9828f942144'] Sep 30 09:46:18.128656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:17Z,description=,direction='ingress',ethertype='IPv6',id=1bd1babc-a82f-4c46-96ee-0232b0f5363b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a8f8c0108e1d45c6984325afff2c5fe9',protocol=,remote_address_group_id=,remote_group_id=d3c5eff9-c13d-49aa-b79e-a9828f942144,remote_ip_prefix=,revision_number=0,security_group_id=d3c5eff9-c13d-49aa-b79e-a9828f942144,updated_at=2022-09-30T09:46:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:18.129298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (1bd1babc-a82f-4c46-96ee-0232b0f5363b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.130152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Security group rule updated ['d3c5eff9-c13d-49aa-b79e-a9828f942144'] Sep 30 09:46:18.131023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:17Z,description=,direction='egress',ethertype='IPv6',id=74d31c82-120d-4e6a-9e06-9c9823b406ee,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a8f8c0108e1d45c6984325afff2c5fe9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d3c5eff9-c13d-49aa-b79e-a9828f942144,updated_at=2022-09-30T09:46:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:18.132489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (74d31c82-120d-4e6a-9e06-9c9823b406ee), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.133020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Security group rule updated ['d3c5eff9-c13d-49aa-b79e-a9828f942144'] Sep 30 09:46:18.133835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:17Z,description=,direction='egress',ethertype='IPv4',id=7b62ce83-7d22-420a-a645-6ae46973e732,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a8f8c0108e1d45c6984325afff2c5fe9',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d3c5eff9-c13d-49aa-b79e-a9828f942144,updated_at=2022-09-30T09:46:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:18.134498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7b62ce83-7d22-420a-a645-6ae46973e732), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.135741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0071f0df-7814-4257-a3bd-af2788b11d12 admin admin] Security group rule updated ['d3c5eff9-c13d-49aa-b79e-a9828f942144'] Sep 30 09:46:18.236190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:262 started Sep 30 09:46:18.238786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0398,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=738000000,duration_sec=536,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:18.239380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:18.239712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:262 - starting polling. Elapsed:0.004 Sep 30 09:46:18.242094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.245100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:262 - port information retrieved. Elapsed:0.009 Sep 30 09:46:18.245445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:262 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:46:18.290465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b0c5b794-bb3e-48ff-a333-2dc563ebe099 service neutron] Resource Port 8588e984-7119-40f8-9e2a-800c04c4c6aa updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=8588e984-7119-40f8-9e2a-800c04c4c6aa,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=8588e984-7119-40f8-9e2a-800c04c4c6aa,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=8588e984-7119-40f8-9e2a-800c04c4c6aa,segment=NetworkSegment(2ac308fb-7102-4667-bb4c-5798a82aae29),segment_id=2ac308fb-7102-4667-bb4c-5798a82aae29)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:18.291076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b0c5b794-bb3e-48ff-a333-2dc563ebe099 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (8588e984-7119-40f8-9e2a-800c04c4c6aa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.527628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Resource SecurityGroup deleted: d3c5eff9-c13d-49aa-b79e-a9828f942144 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:18.528007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (d3c5eff9-c13d-49aa-b79e-a9828f942144), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.528455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d3c5eff9-c13d-49aa-b79e-a9828f942144',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:18.544672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d3c5eff9-c13d-49aa-b79e-a9828f942144',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:18.545705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Resource SecurityGroupRule deleted: 16b55b9e-1f4e-4d02-a125-f856ff20cfa7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:18.546056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (16b55b9e-1f4e-4d02-a125-f856ff20cfa7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.546390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Security group rule updated ['d3c5eff9-c13d-49aa-b79e-a9828f942144'] Sep 30 09:46:18.546813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Resource SecurityGroupRule deleted: 1bd1babc-a82f-4c46-96ee-0232b0f5363b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:18.547161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (1bd1babc-a82f-4c46-96ee-0232b0f5363b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.547479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Security group rule updated ['d3c5eff9-c13d-49aa-b79e-a9828f942144'] Sep 30 09:46:18.547868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Resource SecurityGroupRule deleted: 74d31c82-120d-4e6a-9e06-9c9823b406ee {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:18.548738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (74d31c82-120d-4e6a-9e06-9c9823b406ee), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.549089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Security group rule updated ['d3c5eff9-c13d-49aa-b79e-a9828f942144'] Sep 30 09:46:18.549427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Resource SecurityGroupRule deleted: 7b62ce83-7d22-420a-a645-6ae46973e732 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:18.549843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7b62ce83-7d22-420a-a645-6ae46973e732), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:18.550070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-236aadb1-e248-4965-a041-1f4f9528c611 admin admin] Security group rule updated ['d3c5eff9-c13d-49aa-b79e-a9828f942144'] Sep 30 09:46:19.299868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:18Z,description='Default security group',id=f05fb10a-1619-49ff-81b3-67a4f9324091,is_default=True,name='default',project_id='e9ef243fe44845d3a4c631111a5c9ca8',revision_number=1,rules=[SecurityGroupRule(27d9855f-f184-4d3e-a18e-0895306f519c),SecurityGroupRule(5a11af9a-ed47-4fe4-8af4-94e3300c301b),SecurityGroupRule(bc6db030-6b31-4917-89de-10a555ea84f9),SecurityGroupRule(f24efef8-4166-4e83-b526-9e77c359e9d9)],shared=False,stateful=True,updated_at=2022-09-30T09:46:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:19.301224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (f05fb10a-1619-49ff-81b3-67a4f9324091), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:19.302299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:19Z,description=,direction='egress',ethertype='IPv4',id=27d9855f-f184-4d3e-a18e-0895306f519c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e9ef243fe44845d3a4c631111a5c9ca8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f05fb10a-1619-49ff-81b3-67a4f9324091,updated_at=2022-09-30T09:46:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:19.303925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (27d9855f-f184-4d3e-a18e-0895306f519c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:19.304575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Security group rule updated ['f05fb10a-1619-49ff-81b3-67a4f9324091'] Sep 30 09:46:19.305610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:19Z,description=,direction='ingress',ethertype='IPv6',id=5a11af9a-ed47-4fe4-8af4-94e3300c301b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e9ef243fe44845d3a4c631111a5c9ca8',protocol=,remote_address_group_id=,remote_group_id=f05fb10a-1619-49ff-81b3-67a4f9324091,remote_ip_prefix=,revision_number=0,security_group_id=f05fb10a-1619-49ff-81b3-67a4f9324091,updated_at=2022-09-30T09:46:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:19.306210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5a11af9a-ed47-4fe4-8af4-94e3300c301b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:19.306788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Security group rule updated ['f05fb10a-1619-49ff-81b3-67a4f9324091'] Sep 30 09:46:19.307697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:19Z,description=,direction='ingress',ethertype='IPv4',id=bc6db030-6b31-4917-89de-10a555ea84f9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e9ef243fe44845d3a4c631111a5c9ca8',protocol=,remote_address_group_id=,remote_group_id=f05fb10a-1619-49ff-81b3-67a4f9324091,remote_ip_prefix=,revision_number=0,security_group_id=f05fb10a-1619-49ff-81b3-67a4f9324091,updated_at=2022-09-30T09:46:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:19.308406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (bc6db030-6b31-4917-89de-10a555ea84f9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:19.308935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Security group rule updated ['f05fb10a-1619-49ff-81b3-67a4f9324091'] Sep 30 09:46:19.309755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:19Z,description=,direction='egress',ethertype='IPv6',id=f24efef8-4166-4e83-b526-9e77c359e9d9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e9ef243fe44845d3a4c631111a5c9ca8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f05fb10a-1619-49ff-81b3-67a4f9324091,updated_at=2022-09-30T09:46:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:19.310115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f24efef8-4166-4e83-b526-9e77c359e9d9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:19.310445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-87ecb785-18e8-4ef0-986d-bb092683fe41 admin admin] Security group rule updated ['f05fb10a-1619-49ff-81b3-67a4f9324091'] Sep 30 09:46:19.626103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Resource SecurityGroup deleted: f05fb10a-1619-49ff-81b3-67a4f9324091 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:19.626575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (f05fb10a-1619-49ff-81b3-67a4f9324091), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:19.627292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f05fb10a-1619-49ff-81b3-67a4f9324091',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:19.646534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f05fb10a-1619-49ff-81b3-67a4f9324091',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:19.653278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Resource SecurityGroupRule deleted: 27d9855f-f184-4d3e-a18e-0895306f519c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:19.653278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (27d9855f-f184-4d3e-a18e-0895306f519c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:19.653278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Security group rule updated ['f05fb10a-1619-49ff-81b3-67a4f9324091'] Sep 30 09:46:19.653278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Resource SecurityGroupRule deleted: 5a11af9a-ed47-4fe4-8af4-94e3300c301b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:19.653278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5a11af9a-ed47-4fe4-8af4-94e3300c301b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:19.654050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Security group rule updated ['f05fb10a-1619-49ff-81b3-67a4f9324091'] Sep 30 09:46:19.654050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Resource SecurityGroupRule deleted: bc6db030-6b31-4917-89de-10a555ea84f9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:19.656859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (bc6db030-6b31-4917-89de-10a555ea84f9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:19.657737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Security group rule updated ['f05fb10a-1619-49ff-81b3-67a4f9324091'] Sep 30 09:46:19.660926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Resource SecurityGroupRule deleted: f24efef8-4166-4e83-b526-9e77c359e9d9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:19.662179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f24efef8-4166-4e83-b526-9e77c359e9d9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:19.663105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ced4f535-f197-4626-a4a1-411ec3850d93 admin admin] Security group rule updated ['f05fb10a-1619-49ff-81b3-67a4f9324091'] Sep 30 09:46:20.236847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:263 started Sep 30 09:46:20.239441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c039a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=739000000,duration_sec=538,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:20.240044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:20.240506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:263 - starting polling. Elapsed:0.004 Sep 30 09:46:20.242752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:20.252744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:263 - port information retrieved. Elapsed:0.016 Sep 30 09:46:20.259301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:263 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.022 Sep 30 09:46:22.239099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:264 started Sep 30 09:46:22.243856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c039c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=743000000,duration_sec=540,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:22.244735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:22.245267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:264 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:46:22.280120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:21Z,description='Default security group',id=ed659530-1361-4d62-9b54-4925ac743539,is_default=True,name='default',project_id='1515f97c9abf462c8119127fa08851b2',revision_number=1,rules=[SecurityGroupRule(00b57584-06ee-4382-a646-86556bf01437),SecurityGroupRule(36dc7cfc-65ef-4944-8737-2cf9938b607c),SecurityGroupRule(4fd2e056-57a8-48c2-9b7b-15c308ef10ac),SecurityGroupRule(7fc3993b-5608-47e1-a337-39a3aa4cc82b)],shared=False,stateful=True,updated_at=2022-09-30T09:46:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:22.280815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (ed659530-1361-4d62-9b54-4925ac743539), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:22.281679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:21Z,description=,direction='ingress',ethertype='IPv6',id=00b57584-06ee-4382-a646-86556bf01437,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1515f97c9abf462c8119127fa08851b2',protocol=,remote_address_group_id=,remote_group_id=ed659530-1361-4d62-9b54-4925ac743539,remote_ip_prefix=,revision_number=0,security_group_id=ed659530-1361-4d62-9b54-4925ac743539,updated_at=2022-09-30T09:46:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:22.282281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (00b57584-06ee-4382-a646-86556bf01437), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:22.282808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Security group rule updated ['ed659530-1361-4d62-9b54-4925ac743539'] Sep 30 09:46:22.283731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:21Z,description=,direction='ingress',ethertype='IPv4',id=36dc7cfc-65ef-4944-8737-2cf9938b607c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1515f97c9abf462c8119127fa08851b2',protocol=,remote_address_group_id=,remote_group_id=ed659530-1361-4d62-9b54-4925ac743539,remote_ip_prefix=,revision_number=0,security_group_id=ed659530-1361-4d62-9b54-4925ac743539,updated_at=2022-09-30T09:46:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:22.285037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (36dc7cfc-65ef-4944-8737-2cf9938b607c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:22.286207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Security group rule updated ['ed659530-1361-4d62-9b54-4925ac743539'] Sep 30 09:46:22.287722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:21Z,description=,direction='egress',ethertype='IPv4',id=4fd2e056-57a8-48c2-9b7b-15c308ef10ac,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1515f97c9abf462c8119127fa08851b2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ed659530-1361-4d62-9b54-4925ac743539,updated_at=2022-09-30T09:46:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:22.288281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4fd2e056-57a8-48c2-9b7b-15c308ef10ac), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:22.288767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Security group rule updated ['ed659530-1361-4d62-9b54-4925ac743539'] Sep 30 09:46:22.292628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:21Z,description=,direction='egress',ethertype='IPv6',id=7fc3993b-5608-47e1-a337-39a3aa4cc82b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1515f97c9abf462c8119127fa08851b2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ed659530-1361-4d62-9b54-4925ac743539,updated_at=2022-09-30T09:46:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:22.293182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7fc3993b-5608-47e1-a337-39a3aa4cc82b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:22.294775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-14b59838-85ad-452a-bc82-13a072cb93c1 admin admin] Security group rule updated ['ed659530-1361-4d62-9b54-4925ac743539'] Sep 30 09:46:22.590980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Resource SecurityGroup deleted: ed659530-1361-4d62-9b54-4925ac743539 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:22.590980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (ed659530-1361-4d62-9b54-4925ac743539), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:22.590980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ed659530-1361-4d62-9b54-4925ac743539',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:22.617016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ed659530-1361-4d62-9b54-4925ac743539',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:22.617847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Resource SecurityGroupRule deleted: 00b57584-06ee-4382-a646-86556bf01437 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:22.617847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (00b57584-06ee-4382-a646-86556bf01437), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:22.618131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Security group rule updated ['ed659530-1361-4d62-9b54-4925ac743539'] Sep 30 09:46:22.618631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Resource SecurityGroupRule deleted: 36dc7cfc-65ef-4944-8737-2cf9938b607c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:22.621726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (36dc7cfc-65ef-4944-8737-2cf9938b607c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:22.624174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Security group rule updated ['ed659530-1361-4d62-9b54-4925ac743539'] Sep 30 09:46:22.624992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Resource SecurityGroupRule deleted: 4fd2e056-57a8-48c2-9b7b-15c308ef10ac {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:22.627504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4fd2e056-57a8-48c2-9b7b-15c308ef10ac), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:22.628043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Security group rule updated ['ed659530-1361-4d62-9b54-4925ac743539'] Sep 30 09:46:22.628653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Resource SecurityGroupRule deleted: 7fc3993b-5608-47e1-a337-39a3aa4cc82b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:22.630210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7fc3993b-5608-47e1-a337-39a3aa4cc82b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:22.630798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dbd0e8a2-07d0-4f47-a23a-fac4916318e4 admin admin] Security group rule updated ['ed659530-1361-4d62-9b54-4925ac743539'] Sep 30 09:46:24.239220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:265 started Sep 30 09:46:24.242472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c039e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=742000000,duration_sec=542,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:24.243068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:24.246490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:265 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:46:24.977906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-589bde22-d629-491b-82cf-2343c741f305 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:46:24Z,data_plane_status=None,description='',device_id='0bc1e701-2247-4837-81c0-289806279c31',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=cc523046-219f-42b7-a7b9-700936140c81,mac_address=fa:16:3e:a5:a0:df,name='',network_id=d038a068-f643-497f-8e6f-7d6e8fb5892b,numa_affinity_policy=,project_id='86e6b0501cb94028be07bddd2182638b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(cc523046-219f-42b7-a7b9-700936140c81),security_group_ids=set([2cd1a216-c2a2-4cfa-a192-c5feb95a64d5]),status='DOWN',updated_at=2022-09-30T09:46:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:24.978853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-589bde22-d629-491b-82cf-2343c741f305 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (cc523046-219f-42b7-a7b9-700936140c81), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:24.979658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-589bde22-d629-491b-82cf-2343c741f305 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group member updated {'2cd1a216-c2a2-4cfa-a192-c5feb95a64d5'} Sep 30 09:46:25.014837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:24Z,description='Default security group',id=fe266b07-6fcb-43a1-af78-9715cf87cb8f,is_default=True,name='default',project_id='067163b9757d46f7918f11725bdc007d',revision_number=1,rules=[SecurityGroupRule(1350a684-271f-4360-a702-790ed8d6c26f),SecurityGroupRule(6d04a242-154c-4f64-90d0-c57cc13bd3e6),SecurityGroupRule(8814dff2-42cf-47a4-9b66-a407db40ddb3),SecurityGroupRule(97483e79-7bb0-44b6-beb6-f17be8a1418b)],shared=False,stateful=True,updated_at=2022-09-30T09:46:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:25.015680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (fe266b07-6fcb-43a1-af78-9715cf87cb8f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:25.016540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:24Z,description=,direction='ingress',ethertype='IPv4',id=1350a684-271f-4360-a702-790ed8d6c26f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='067163b9757d46f7918f11725bdc007d',protocol=,remote_address_group_id=,remote_group_id=fe266b07-6fcb-43a1-af78-9715cf87cb8f,remote_ip_prefix=,revision_number=0,security_group_id=fe266b07-6fcb-43a1-af78-9715cf87cb8f,updated_at=2022-09-30T09:46:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:25.017654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (1350a684-271f-4360-a702-790ed8d6c26f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:25.018280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Security group rule updated ['fe266b07-6fcb-43a1-af78-9715cf87cb8f'] Sep 30 09:46:25.021826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:24Z,description=,direction='egress',ethertype='IPv4',id=6d04a242-154c-4f64-90d0-c57cc13bd3e6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='067163b9757d46f7918f11725bdc007d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fe266b07-6fcb-43a1-af78-9715cf87cb8f,updated_at=2022-09-30T09:46:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:25.022455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (6d04a242-154c-4f64-90d0-c57cc13bd3e6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:25.023087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Security group rule updated ['fe266b07-6fcb-43a1-af78-9715cf87cb8f'] Sep 30 09:46:25.023963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:24Z,description=,direction='egress',ethertype='IPv6',id=8814dff2-42cf-47a4-9b66-a407db40ddb3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='067163b9757d46f7918f11725bdc007d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fe266b07-6fcb-43a1-af78-9715cf87cb8f,updated_at=2022-09-30T09:46:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:25.024936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8814dff2-42cf-47a4-9b66-a407db40ddb3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:25.025997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Security group rule updated ['fe266b07-6fcb-43a1-af78-9715cf87cb8f'] Sep 30 09:46:25.029908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:24Z,description=,direction='ingress',ethertype='IPv6',id=97483e79-7bb0-44b6-beb6-f17be8a1418b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='067163b9757d46f7918f11725bdc007d',protocol=,remote_address_group_id=,remote_group_id=fe266b07-6fcb-43a1-af78-9715cf87cb8f,remote_ip_prefix=,revision_number=0,security_group_id=fe266b07-6fcb-43a1-af78-9715cf87cb8f,updated_at=2022-09-30T09:46:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:25.030479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (97483e79-7bb0-44b6-beb6-f17be8a1418b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:25.031010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f9754566-9c23-4a5e-988f-380e683e63e4 admin admin] Security group rule updated ['fe266b07-6fcb-43a1-af78-9715cf87cb8f'] Sep 30 09:46:25.379283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Resource SecurityGroup deleted: fe266b07-6fcb-43a1-af78-9715cf87cb8f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:25.379888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (fe266b07-6fcb-43a1-af78-9715cf87cb8f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:25.380113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fe266b07-6fcb-43a1-af78-9715cf87cb8f',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:25.396211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fe266b07-6fcb-43a1-af78-9715cf87cb8f',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:25.396946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Resource SecurityGroupRule deleted: 1350a684-271f-4360-a702-790ed8d6c26f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:25.397321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (1350a684-271f-4360-a702-790ed8d6c26f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:25.398108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Security group rule updated ['fe266b07-6fcb-43a1-af78-9715cf87cb8f'] Sep 30 09:46:25.398512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Resource SecurityGroupRule deleted: 6d04a242-154c-4f64-90d0-c57cc13bd3e6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:25.398904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (6d04a242-154c-4f64-90d0-c57cc13bd3e6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:25.404263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Security group rule updated ['fe266b07-6fcb-43a1-af78-9715cf87cb8f'] Sep 30 09:46:25.404688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Resource SecurityGroupRule deleted: 8814dff2-42cf-47a4-9b66-a407db40ddb3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:25.405059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8814dff2-42cf-47a4-9b66-a407db40ddb3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:25.405394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Security group rule updated ['fe266b07-6fcb-43a1-af78-9715cf87cb8f'] Sep 30 09:46:25.405770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Resource SecurityGroupRule deleted: 97483e79-7bb0-44b6-beb6-f17be8a1418b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:25.406118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (97483e79-7bb0-44b6-beb6-f17be8a1418b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:25.406445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-064c5d80-d877-40ca-9abb-c273807de3a2 admin admin] Security group rule updated ['fe266b07-6fcb-43a1-af78-9715cf87cb8f'] Sep 30 09:46:26.240101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:266 started Sep 30 09:46:26.242569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=742000000,duration_sec=544,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:26.243484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:26.243762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:266 - starting polling. Elapsed:0.004 Sep 30 09:46:26.245823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.248876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:266 - port information retrieved. Elapsed:0.009 Sep 30 09:46:26.249439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:266 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 30 09:46:26.309215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:26Z,description='Default security group',id=ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e,is_default=True,name='default',project_id='df9900d26732437b9f775eb11d6352ce',revision_number=1,rules=[SecurityGroupRule(082ccd07-d383-41fa-a715-0ba3ecc52ac8),SecurityGroupRule(218a5be0-ed8e-457b-8572-2e93551c2f9b),SecurityGroupRule(537bc279-0b1a-4695-93a3-463dbc209151),SecurityGroupRule(8321dda5-6bec-4a35-926f-2060c2f82084)],shared=False,stateful=True,updated_at=2022-09-30T09:46:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:26.309660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.310366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:26Z,description=,direction='egress',ethertype='IPv6',id=082ccd07-d383-41fa-a715-0ba3ecc52ac8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='df9900d26732437b9f775eb11d6352ce',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e,updated_at=2022-09-30T09:46:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:26.310749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (082ccd07-d383-41fa-a715-0ba3ecc52ac8), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.311273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Security group rule updated ['ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e'] Sep 30 09:46:26.312045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:26Z,description=,direction='ingress',ethertype='IPv4',id=218a5be0-ed8e-457b-8572-2e93551c2f9b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='df9900d26732437b9f775eb11d6352ce',protocol=,remote_address_group_id=,remote_group_id=ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e,remote_ip_prefix=,revision_number=0,security_group_id=ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e,updated_at=2022-09-30T09:46:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:26.312502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (218a5be0-ed8e-457b-8572-2e93551c2f9b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.312948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Security group rule updated ['ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e'] Sep 30 09:46:26.313601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:26Z,description=,direction='ingress',ethertype='IPv6',id=537bc279-0b1a-4695-93a3-463dbc209151,normalized_cidr=None,port_range_max=,port_range_min=,project_id='df9900d26732437b9f775eb11d6352ce',protocol=,remote_address_group_id=,remote_group_id=ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e,remote_ip_prefix=,revision_number=0,security_group_id=ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e,updated_at=2022-09-30T09:46:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:26.314182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (537bc279-0b1a-4695-93a3-463dbc209151), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.314511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Security group rule updated ['ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e'] Sep 30 09:46:26.315189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:26Z,description=,direction='egress',ethertype='IPv4',id=8321dda5-6bec-4a35-926f-2060c2f82084,normalized_cidr=None,port_range_max=,port_range_min=,project_id='df9900d26732437b9f775eb11d6352ce',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e,updated_at=2022-09-30T09:46:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:26.315746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8321dda5-6bec-4a35-926f-2060c2f82084), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.316226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a9257152-2396-4b66-9eb4-f7bc6c2a8264 admin admin] Security group rule updated ['ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e'] Sep 30 09:46:26.536675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Resource SecurityGroup deleted: ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:26.537302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.537720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:26.571783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:26.572844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Resource SecurityGroupRule deleted: 082ccd07-d383-41fa-a715-0ba3ecc52ac8 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:26.573762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (082ccd07-d383-41fa-a715-0ba3ecc52ac8), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.574305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Security group rule updated ['ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e'] Sep 30 09:46:26.575089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Resource SecurityGroupRule deleted: 218a5be0-ed8e-457b-8572-2e93551c2f9b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:26.576187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (218a5be0-ed8e-457b-8572-2e93551c2f9b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.576711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Security group rule updated ['ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e'] Sep 30 09:46:26.577310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Resource SecurityGroupRule deleted: 537bc279-0b1a-4695-93a3-463dbc209151 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:26.577936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (537bc279-0b1a-4695-93a3-463dbc209151), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.578923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Security group rule updated ['ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e'] Sep 30 09:46:26.581976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Resource SecurityGroupRule deleted: 8321dda5-6bec-4a35-926f-2060c2f82084 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:26.581976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8321dda5-6bec-4a35-926f-2060c2f82084), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.581976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5c856eee-b351-4d9a-b928-6ea0ffdcd463 admin admin] Security group rule updated ['ba7eac61-dae1-405b-b1fc-c1f2bea6ed8e'] Sep 30 09:46:26.619225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:26Z,description='Default security group',id=7468c662-ef09-4e2c-aa5c-dd4563a8996c,is_default=True,name='default',project_id='2cb74e9c881a43189117a06e1294e083',revision_number=1,rules=[SecurityGroupRule(23d6916e-3c0a-45ee-acad-110f82ed084b),SecurityGroupRule(4168f84b-4a76-4a5e-8a9a-dc160757ebab),SecurityGroupRule(6c319c54-bed6-4018-bfb8-4324c97ea94e),SecurityGroupRule(93426360-9c12-4199-99e2-0eafa5dc4ec1)],shared=False,stateful=True,updated_at=2022-09-30T09:46:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:26.619607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (7468c662-ef09-4e2c-aa5c-dd4563a8996c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.620228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:26Z,description=,direction='egress',ethertype='IPv4',id=23d6916e-3c0a-45ee-acad-110f82ed084b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2cb74e9c881a43189117a06e1294e083',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7468c662-ef09-4e2c-aa5c-dd4563a8996c,updated_at=2022-09-30T09:46:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:26.620581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (23d6916e-3c0a-45ee-acad-110f82ed084b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.621229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Security group rule updated ['7468c662-ef09-4e2c-aa5c-dd4563a8996c'] Sep 30 09:46:26.621903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:26Z,description=,direction='egress',ethertype='IPv6',id=4168f84b-4a76-4a5e-8a9a-dc160757ebab,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2cb74e9c881a43189117a06e1294e083',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7468c662-ef09-4e2c-aa5c-dd4563a8996c,updated_at=2022-09-30T09:46:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:26.622271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4168f84b-4a76-4a5e-8a9a-dc160757ebab), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.622625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Security group rule updated ['7468c662-ef09-4e2c-aa5c-dd4563a8996c'] Sep 30 09:46:26.623972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:26Z,description=,direction='ingress',ethertype='IPv4',id=6c319c54-bed6-4018-bfb8-4324c97ea94e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2cb74e9c881a43189117a06e1294e083',protocol=,remote_address_group_id=,remote_group_id=7468c662-ef09-4e2c-aa5c-dd4563a8996c,remote_ip_prefix=,revision_number=0,security_group_id=7468c662-ef09-4e2c-aa5c-dd4563a8996c,updated_at=2022-09-30T09:46:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:26.623972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (6c319c54-bed6-4018-bfb8-4324c97ea94e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.632835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Security group rule updated ['7468c662-ef09-4e2c-aa5c-dd4563a8996c'] Sep 30 09:46:26.632835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:26Z,description=,direction='ingress',ethertype='IPv6',id=93426360-9c12-4199-99e2-0eafa5dc4ec1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2cb74e9c881a43189117a06e1294e083',protocol=,remote_address_group_id=,remote_group_id=7468c662-ef09-4e2c-aa5c-dd4563a8996c,remote_ip_prefix=,revision_number=0,security_group_id=7468c662-ef09-4e2c-aa5c-dd4563a8996c,updated_at=2022-09-30T09:46:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:26.632835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (93426360-9c12-4199-99e2-0eafa5dc4ec1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.632835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4a1f5efe-ee4c-44f9-9737-cfb96ae14734 admin admin] Security group rule updated ['7468c662-ef09-4e2c-aa5c-dd4563a8996c'] Sep 30 09:46:26.822757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Resource SecurityGroup deleted: 7468c662-ef09-4e2c-aa5c-dd4563a8996c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:26.823284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (7468c662-ef09-4e2c-aa5c-dd4563a8996c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.823757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7468c662-ef09-4e2c-aa5c-dd4563a8996c',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:26.838438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7468c662-ef09-4e2c-aa5c-dd4563a8996c',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:26.838858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Resource SecurityGroupRule deleted: 23d6916e-3c0a-45ee-acad-110f82ed084b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:26.839231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (23d6916e-3c0a-45ee-acad-110f82ed084b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.839618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Security group rule updated ['7468c662-ef09-4e2c-aa5c-dd4563a8996c'] Sep 30 09:46:26.840010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Resource SecurityGroupRule deleted: 4168f84b-4a76-4a5e-8a9a-dc160757ebab {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:26.840355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4168f84b-4a76-4a5e-8a9a-dc160757ebab), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.840674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Security group rule updated ['7468c662-ef09-4e2c-aa5c-dd4563a8996c'] Sep 30 09:46:26.841073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Resource SecurityGroupRule deleted: 6c319c54-bed6-4018-bfb8-4324c97ea94e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:26.842022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (6c319c54-bed6-4018-bfb8-4324c97ea94e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.842345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Security group rule updated ['7468c662-ef09-4e2c-aa5c-dd4563a8996c'] Sep 30 09:46:26.842741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Resource SecurityGroupRule deleted: 93426360-9c12-4199-99e2-0eafa5dc4ec1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:26.843082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (93426360-9c12-4199-99e2-0eafa5dc4ec1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:26.843395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-43196cc5-8a3d-42d9-8ec6-4b88deffd997 admin admin] Security group rule updated ['7468c662-ef09-4e2c-aa5c-dd4563a8996c'] Sep 30 09:46:27.829125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:27Z,description='Default security group',id=4de8a0ed-cd84-4069-9e4c-9a4e348b85f2,is_default=True,name='default',project_id='0d17d9f4c2d442f08f77adb7703aa309',revision_number=1,rules=[SecurityGroupRule(60d311b8-45a3-4531-98a4-36e6b0f09729),SecurityGroupRule(862f418b-ff8d-41a8-9fb6-f16dfa03e7e0),SecurityGroupRule(b8e6c87b-f28f-4cc6-a5f8-ec882567089c),SecurityGroupRule(e20a27a0-9ce9-4c6f-b852-e52906f67485)],shared=False,stateful=True,updated_at=2022-09-30T09:46:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:27.829729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (4de8a0ed-cd84-4069-9e4c-9a4e348b85f2), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:27.830118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:27Z,description=,direction='ingress',ethertype='IPv6',id=60d311b8-45a3-4531-98a4-36e6b0f09729,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0d17d9f4c2d442f08f77adb7703aa309',protocol=,remote_address_group_id=,remote_group_id=4de8a0ed-cd84-4069-9e4c-9a4e348b85f2,remote_ip_prefix=,revision_number=0,security_group_id=4de8a0ed-cd84-4069-9e4c-9a4e348b85f2,updated_at=2022-09-30T09:46:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:27.830476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (60d311b8-45a3-4531-98a4-36e6b0f09729), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:27.830840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Security group rule updated ['4de8a0ed-cd84-4069-9e4c-9a4e348b85f2'] Sep 30 09:46:27.831519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:27Z,description=,direction='ingress',ethertype='IPv4',id=862f418b-ff8d-41a8-9fb6-f16dfa03e7e0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0d17d9f4c2d442f08f77adb7703aa309',protocol=,remote_address_group_id=,remote_group_id=4de8a0ed-cd84-4069-9e4c-9a4e348b85f2,remote_ip_prefix=,revision_number=0,security_group_id=4de8a0ed-cd84-4069-9e4c-9a4e348b85f2,updated_at=2022-09-30T09:46:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:27.831871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (862f418b-ff8d-41a8-9fb6-f16dfa03e7e0), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:27.832195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Security group rule updated ['4de8a0ed-cd84-4069-9e4c-9a4e348b85f2'] Sep 30 09:46:27.832846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:27Z,description=,direction='egress',ethertype='IPv4',id=b8e6c87b-f28f-4cc6-a5f8-ec882567089c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0d17d9f4c2d442f08f77adb7703aa309',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4de8a0ed-cd84-4069-9e4c-9a4e348b85f2,updated_at=2022-09-30T09:46:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:27.833194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b8e6c87b-f28f-4cc6-a5f8-ec882567089c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:27.833516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Security group rule updated ['4de8a0ed-cd84-4069-9e4c-9a4e348b85f2'] Sep 30 09:46:27.834178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:27Z,description=,direction='egress',ethertype='IPv6',id=e20a27a0-9ce9-4c6f-b852-e52906f67485,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0d17d9f4c2d442f08f77adb7703aa309',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=4de8a0ed-cd84-4069-9e4c-9a4e348b85f2,updated_at=2022-09-30T09:46:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:27.834516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e20a27a0-9ce9-4c6f-b852-e52906f67485), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:27.835193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8bbd6f1a-39c4-4f8e-9dfd-6dc78e73931b admin admin] Security group rule updated ['4de8a0ed-cd84-4069-9e4c-9a4e348b85f2'] Sep 30 09:46:28.071800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Resource SecurityGroup deleted: 4de8a0ed-cd84-4069-9e4c-9a4e348b85f2 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:28.072294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (4de8a0ed-cd84-4069-9e4c-9a4e348b85f2), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:28.072842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('4de8a0ed-cd84-4069-9e4c-9a4e348b85f2',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:28.089341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('4de8a0ed-cd84-4069-9e4c-9a4e348b85f2',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:28.089790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Resource SecurityGroupRule deleted: 60d311b8-45a3-4531-98a4-36e6b0f09729 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:28.090374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (60d311b8-45a3-4531-98a4-36e6b0f09729), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:28.090894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Security group rule updated ['4de8a0ed-cd84-4069-9e4c-9a4e348b85f2'] Sep 30 09:46:28.091866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Resource SecurityGroupRule deleted: 862f418b-ff8d-41a8-9fb6-f16dfa03e7e0 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:28.092384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (862f418b-ff8d-41a8-9fb6-f16dfa03e7e0), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:28.092701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Security group rule updated ['4de8a0ed-cd84-4069-9e4c-9a4e348b85f2'] Sep 30 09:46:28.093206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Resource SecurityGroupRule deleted: b8e6c87b-f28f-4cc6-a5f8-ec882567089c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:28.093883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b8e6c87b-f28f-4cc6-a5f8-ec882567089c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:28.094357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Security group rule updated ['4de8a0ed-cd84-4069-9e4c-9a4e348b85f2'] Sep 30 09:46:28.094925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Resource SecurityGroupRule deleted: e20a27a0-9ce9-4c6f-b852-e52906f67485 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:28.100419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e20a27a0-9ce9-4c6f-b852-e52906f67485), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:28.100419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-adf65023-1945-4893-a21c-fe018d0930c8 admin admin] Security group rule updated ['4de8a0ed-cd84-4069-9e4c-9a4e348b85f2'] Sep 30 09:46:28.240939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:267 started Sep 30 09:46:28.244658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=744000000,duration_sec=546,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:28.244658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:28.245231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:267 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:46:30.241538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:268 started Sep 30 09:46:30.244586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=744000000,duration_sec=548,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:30.245152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:30.245503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:268 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:46:31.413444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1370cee8-0281-4e6e-a51e-f125bf20ab83 service neutron] Resource Port cc523046-219f-42b7-a7b9-700936140c81 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=cc523046-219f-42b7-a7b9-700936140c81,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=cc523046-219f-42b7-a7b9-700936140c81,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:31.414016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1370cee8-0281-4e6e-a51e-f125bf20ab83 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (cc523046-219f-42b7-a7b9-700936140c81), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:31.831472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1370cee8-0281-4e6e-a51e-f125bf20ab83 service neutron] Resource Port cc523046-219f-42b7-a7b9-700936140c81 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=cc523046-219f-42b7-a7b9-700936140c81,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=cc523046-219f-42b7-a7b9-700936140c81,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=cc523046-219f-42b7-a7b9-700936140c81,segment=NetworkSegment(e6b17fb5-eb11-41c5-b8ac-1188c97e0520),segment_id=e6b17fb5-eb11-41c5-b8ac-1188c97e0520)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:31.832070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1370cee8-0281-4e6e-a51e-f125bf20ab83 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (cc523046-219f-42b7-a7b9-700936140c81), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:32.248124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:269 started Sep 30 09:46:32.248124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=745000000,duration_sec=550,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:32.248124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:32.248124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:269 - starting polling. Elapsed:0.004 Sep 30 09:46:32.249187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:32.251755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:269 - port information retrieved. Elapsed:0.009 Sep 30 09:46:32.252084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:269 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:46:34.243737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:270 started Sep 30 09:46:34.246360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=746000000,duration_sec=552,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:34.246946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:34.247836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:270 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:46:36.245599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:271 started Sep 30 09:46:36.248236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=748000000,duration_sec=554,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:36.248800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:36.249154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:271 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:46:37.531083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port d3f7eb0a-905a-4efa-b08a-3fca026724aa updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:37.531639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (d3f7eb0a-905a-4efa-b08a-3fca026724aa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:37.750577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 45105b4f-28b5-44d6-bdd3-42f2c0b33de7 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:37.752532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (45105b4f-28b5-44d6-bdd3-42f2c0b33de7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:38.246580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:272 started Sep 30 09:46:38.253918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=750000000,duration_sec=556,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:38.254312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:38.254684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:272 - starting polling. Elapsed:0.008 Sep 30 09:46:38.256699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:38.259264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:272 - port information retrieved. Elapsed:0.013 Sep 30 09:46:38.259589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:272 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 30 09:46:40.247729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:273 started Sep 30 09:46:40.250096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=750000000,duration_sec=558,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:40.250681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:40.251049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:273 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:46:42.248666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:274 started Sep 30 09:46:42.251280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=751000000,duration_sec=560,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:42.251845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:42.252196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:274 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:46:42.682065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port d3f7eb0a-905a-4efa-b08a-3fca026724aa updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:42.682453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (d3f7eb0a-905a-4efa-b08a-3fca026724aa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:43.143104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 45105b4f-28b5-44d6-bdd3-42f2c0b33de7 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:43.143709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (45105b4f-28b5-44d6-bdd3-42f2c0b33de7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:43.434078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:43Z,description='Default security group',id=79c1f134-f06d-4b1e-b5c1-3ef77cc16c0e,is_default=True,name='default',project_id='c3802ced1fce4997a016d41eca843ef8',revision_number=1,rules=[SecurityGroupRule(25b9bb8a-9003-44d0-ab92-d28afed068ca),SecurityGroupRule(5d5b549b-de03-4b5f-9d1d-b85c72494d36),SecurityGroupRule(964f1b6a-48ce-4278-a090-eb5ee279242f),SecurityGroupRule(bfa2443d-7be3-4e5e-a712-baa56c422e48)],shared=False,stateful=True,updated_at=2022-09-30T09:46:43Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:43.434672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (79c1f134-f06d-4b1e-b5c1-3ef77cc16c0e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:43.435183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:43Z,description=,direction='egress',ethertype='IPv6',id=25b9bb8a-9003-44d0-ab92-d28afed068ca,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c3802ced1fce4997a016d41eca843ef8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=79c1f134-f06d-4b1e-b5c1-3ef77cc16c0e,updated_at=2022-09-30T09:46:43Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:43.435533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (25b9bb8a-9003-44d0-ab92-d28afed068ca), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:43.440946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Security group rule updated ['79c1f134-f06d-4b1e-b5c1-3ef77cc16c0e'] Sep 30 09:46:43.440946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:43Z,description=,direction='ingress',ethertype='IPv6',id=5d5b549b-de03-4b5f-9d1d-b85c72494d36,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c3802ced1fce4997a016d41eca843ef8',protocol=,remote_address_group_id=,remote_group_id=79c1f134-f06d-4b1e-b5c1-3ef77cc16c0e,remote_ip_prefix=,revision_number=0,security_group_id=79c1f134-f06d-4b1e-b5c1-3ef77cc16c0e,updated_at=2022-09-30T09:46:43Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:43.440946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5d5b549b-de03-4b5f-9d1d-b85c72494d36), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:43.440946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Security group rule updated ['79c1f134-f06d-4b1e-b5c1-3ef77cc16c0e'] Sep 30 09:46:43.441394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:43Z,description=,direction='egress',ethertype='IPv4',id=964f1b6a-48ce-4278-a090-eb5ee279242f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c3802ced1fce4997a016d41eca843ef8',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=79c1f134-f06d-4b1e-b5c1-3ef77cc16c0e,updated_at=2022-09-30T09:46:43Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:43.441394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (964f1b6a-48ce-4278-a090-eb5ee279242f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:43.441394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Security group rule updated ['79c1f134-f06d-4b1e-b5c1-3ef77cc16c0e'] Sep 30 09:46:43.441636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:43Z,description=,direction='ingress',ethertype='IPv4',id=bfa2443d-7be3-4e5e-a712-baa56c422e48,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c3802ced1fce4997a016d41eca843ef8',protocol=,remote_address_group_id=,remote_group_id=79c1f134-f06d-4b1e-b5c1-3ef77cc16c0e,remote_ip_prefix=,revision_number=0,security_group_id=79c1f134-f06d-4b1e-b5c1-3ef77cc16c0e,updated_at=2022-09-30T09:46:43Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:43.441636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (bfa2443d-7be3-4e5e-a712-baa56c422e48), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:43.441636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-525c3d6a-7fea-43a9-a1f4-5cfba076a995 service neutron] Security group rule updated ['79c1f134-f06d-4b1e-b5c1-3ef77cc16c0e'] Sep 30 09:46:44.249377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:275 started Sep 30 09:46:44.251785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=752000000,duration_sec=562,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:44.252354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:44.252683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:275 - starting polling. Elapsed:0.003 Sep 30 09:46:44.254719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:44.257249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:275 - port information retrieved. Elapsed:0.008 Sep 30 09:46:44.257577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:275 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:46:46.136099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 8588e984-7119-40f8-9e2a-800c04c4c6aa updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:46.136717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (8588e984-7119-40f8-9e2a-800c04c4c6aa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:46.249832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:276 started Sep 30 09:46:46.252194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=752000000,duration_sec=564,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:46.257300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:46.257300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:276 - starting polling. Elapsed:0.003 Sep 30 09:46:46.257300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:46.257749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:276 - port information retrieved. Elapsed:0.008 Sep 30 09:46:46.258080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:276 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:46:46.395715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port cc523046-219f-42b7-a7b9-700936140c81 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:46.396094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (cc523046-219f-42b7-a7b9-700936140c81), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:48.251316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:277 started Sep 30 09:46:48.254016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=754000000,duration_sec=566,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:48.254648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:48.255005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:277 - starting polling. Elapsed:0.004 Sep 30 09:46:48.257016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:48.259723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:277 - port information retrieved. Elapsed:0.009 Sep 30 09:46:48.260185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:277 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:46:49.367465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 8588e984-7119-40f8-9e2a-800c04c4c6aa updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:49.368109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (8588e984-7119-40f8-9e2a-800c04c4c6aa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:49.756108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port cc523046-219f-42b7-a7b9-700936140c81 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:46:49.756543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (cc523046-219f-42b7-a7b9-700936140c81), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.251895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:278 started Sep 30 09:46:50.255434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03b8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=755000000,duration_sec=568,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:50.257324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:50.257324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:278 - starting polling. Elapsed:0.005 Sep 30 09:46:50.259344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.262076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:278 - port information retrieved. Elapsed:0.010 Sep 30 09:46:50.262414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:278 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:46:50.445930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:50Z,description='Default security group',id=052c2441-5354-46ce-9278-785f42234917,is_default=True,name='default',project_id='6d70aed35ae04e5fb792cbf92ac67c71',revision_number=1,rules=[SecurityGroupRule(33b4725b-9498-440a-8330-a5fa86e812ef),SecurityGroupRule(3f9e18bc-119b-4c9c-bd24-cfdfe89992a5),SecurityGroupRule(8da6b75b-50dd-4de1-9977-cce2e54c897d),SecurityGroupRule(c3462c2d-af9f-4a5b-8bbe-c20751fa7644)],shared=False,stateful=True,updated_at=2022-09-30T09:46:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:50.446535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (052c2441-5354-46ce-9278-785f42234917), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.446995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:50Z,description=,direction='egress',ethertype='IPv6',id=33b4725b-9498-440a-8330-a5fa86e812ef,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6d70aed35ae04e5fb792cbf92ac67c71',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=052c2441-5354-46ce-9278-785f42234917,updated_at=2022-09-30T09:46:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:50.447214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (33b4725b-9498-440a-8330-a5fa86e812ef), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.447567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Security group rule updated ['052c2441-5354-46ce-9278-785f42234917'] Sep 30 09:46:50.448224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:50Z,description=,direction='ingress',ethertype='IPv6',id=3f9e18bc-119b-4c9c-bd24-cfdfe89992a5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6d70aed35ae04e5fb792cbf92ac67c71',protocol=,remote_address_group_id=,remote_group_id=052c2441-5354-46ce-9278-785f42234917,remote_ip_prefix=,revision_number=0,security_group_id=052c2441-5354-46ce-9278-785f42234917,updated_at=2022-09-30T09:46:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:50.448574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (3f9e18bc-119b-4c9c-bd24-cfdfe89992a5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.450491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Security group rule updated ['052c2441-5354-46ce-9278-785f42234917'] Sep 30 09:46:50.450491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:50Z,description=,direction='ingress',ethertype='IPv4',id=8da6b75b-50dd-4de1-9977-cce2e54c897d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6d70aed35ae04e5fb792cbf92ac67c71',protocol=,remote_address_group_id=,remote_group_id=052c2441-5354-46ce-9278-785f42234917,remote_ip_prefix=,revision_number=0,security_group_id=052c2441-5354-46ce-9278-785f42234917,updated_at=2022-09-30T09:46:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:50.450491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8da6b75b-50dd-4de1-9977-cce2e54c897d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.450491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Security group rule updated ['052c2441-5354-46ce-9278-785f42234917'] Sep 30 09:46:50.450949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:50Z,description=,direction='egress',ethertype='IPv4',id=c3462c2d-af9f-4a5b-8bbe-c20751fa7644,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6d70aed35ae04e5fb792cbf92ac67c71',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=052c2441-5354-46ce-9278-785f42234917,updated_at=2022-09-30T09:46:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:50.451186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c3462c2d-af9f-4a5b-8bbe-c20751fa7644), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.451532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-887cd49e-cf98-4310-b243-cb4164849682 admin admin] Security group rule updated ['052c2441-5354-46ce-9278-785f42234917'] Sep 30 09:46:50.759056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:50Z,description='Default security group',id=7cfc1ce5-d50d-4d42-a980-57056cde8abd,is_default=True,name='default',project_id='9a686dae16a04996ad351ddb92875e0e',revision_number=1,rules=[SecurityGroupRule(2ea8fca3-f303-49fb-b8c0-245d7f8122b4),SecurityGroupRule(4a04f879-384d-489a-851f-a07cfe46af46),SecurityGroupRule(7878de73-9ebd-4a3e-bea4-ce8bede3383e),SecurityGroupRule(dfff8676-5e99-446c-adc2-d63c4f8c9e65)],shared=False,stateful=True,updated_at=2022-09-30T09:46:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:50.759633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (7cfc1ce5-d50d-4d42-a980-57056cde8abd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.760658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:50Z,description=,direction='ingress',ethertype='IPv6',id=2ea8fca3-f303-49fb-b8c0-245d7f8122b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9a686dae16a04996ad351ddb92875e0e',protocol=,remote_address_group_id=,remote_group_id=7cfc1ce5-d50d-4d42-a980-57056cde8abd,remote_ip_prefix=,revision_number=0,security_group_id=7cfc1ce5-d50d-4d42-a980-57056cde8abd,updated_at=2022-09-30T09:46:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:50.764100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2ea8fca3-f303-49fb-b8c0-245d7f8122b4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.764452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Security group rule updated ['7cfc1ce5-d50d-4d42-a980-57056cde8abd'] Sep 30 09:46:50.765170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:50Z,description=,direction='egress',ethertype='IPv6',id=4a04f879-384d-489a-851f-a07cfe46af46,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9a686dae16a04996ad351ddb92875e0e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7cfc1ce5-d50d-4d42-a980-57056cde8abd,updated_at=2022-09-30T09:46:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:50.765532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4a04f879-384d-489a-851f-a07cfe46af46), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.765863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Security group rule updated ['7cfc1ce5-d50d-4d42-a980-57056cde8abd'] Sep 30 09:46:50.767147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:50Z,description=,direction='egress',ethertype='IPv4',id=7878de73-9ebd-4a3e-bea4-ce8bede3383e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9a686dae16a04996ad351ddb92875e0e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7cfc1ce5-d50d-4d42-a980-57056cde8abd,updated_at=2022-09-30T09:46:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:50.767502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7878de73-9ebd-4a3e-bea4-ce8bede3383e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.768076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Security group rule updated ['7cfc1ce5-d50d-4d42-a980-57056cde8abd'] Sep 30 09:46:50.768889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:50Z,description=,direction='ingress',ethertype='IPv4',id=dfff8676-5e99-446c-adc2-d63c4f8c9e65,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9a686dae16a04996ad351ddb92875e0e',protocol=,remote_address_group_id=,remote_group_id=7cfc1ce5-d50d-4d42-a980-57056cde8abd,remote_ip_prefix=,revision_number=0,security_group_id=7cfc1ce5-d50d-4d42-a980-57056cde8abd,updated_at=2022-09-30T09:46:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:50.770534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (dfff8676-5e99-446c-adc2-d63c4f8c9e65), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.771815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5f8a3269-20d8-474e-9281-f27769899063 admin admin] Security group rule updated ['7cfc1ce5-d50d-4d42-a980-57056cde8abd'] Sep 30 09:46:50.780847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Resource SecurityGroup deleted: 052c2441-5354-46ce-9278-785f42234917 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:50.781399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (052c2441-5354-46ce-9278-785f42234917), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.782003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('052c2441-5354-46ce-9278-785f42234917',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:50.816794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('052c2441-5354-46ce-9278-785f42234917',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:50.817760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Resource SecurityGroupRule deleted: 33b4725b-9498-440a-8330-a5fa86e812ef {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:50.818293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (33b4725b-9498-440a-8330-a5fa86e812ef), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.818794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Security group rule updated ['052c2441-5354-46ce-9278-785f42234917'] Sep 30 09:46:50.819339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Resource SecurityGroupRule deleted: 3f9e18bc-119b-4c9c-bd24-cfdfe89992a5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:50.819880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (3f9e18bc-119b-4c9c-bd24-cfdfe89992a5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.820392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Security group rule updated ['052c2441-5354-46ce-9278-785f42234917'] Sep 30 09:46:50.821101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Resource SecurityGroupRule deleted: 8da6b75b-50dd-4de1-9977-cce2e54c897d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:50.821458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8da6b75b-50dd-4de1-9977-cce2e54c897d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.821783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Security group rule updated ['052c2441-5354-46ce-9278-785f42234917'] Sep 30 09:46:50.822205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Resource SecurityGroupRule deleted: c3462c2d-af9f-4a5b-8bbe-c20751fa7644 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:50.822554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c3462c2d-af9f-4a5b-8bbe-c20751fa7644), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:50.823056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-944273bb-ede8-43a9-9a3e-f9897621001a admin admin] Security group rule updated ['052c2441-5354-46ce-9278-785f42234917'] Sep 30 09:46:51.020668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Resource SecurityGroup deleted: 7cfc1ce5-d50d-4d42-a980-57056cde8abd {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:51.021229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (7cfc1ce5-d50d-4d42-a980-57056cde8abd), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:51.021860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7cfc1ce5-d50d-4d42-a980-57056cde8abd',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:51.040084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7cfc1ce5-d50d-4d42-a980-57056cde8abd',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:51.040084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Resource SecurityGroupRule deleted: 2ea8fca3-f303-49fb-b8c0-245d7f8122b4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:51.040084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2ea8fca3-f303-49fb-b8c0-245d7f8122b4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:51.040084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Security group rule updated ['7cfc1ce5-d50d-4d42-a980-57056cde8abd'] Sep 30 09:46:51.040084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Resource SecurityGroupRule deleted: 4a04f879-384d-489a-851f-a07cfe46af46 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:51.040447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4a04f879-384d-489a-851f-a07cfe46af46), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:51.040447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Security group rule updated ['7cfc1ce5-d50d-4d42-a980-57056cde8abd'] Sep 30 09:46:51.040447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Resource SecurityGroupRule deleted: 7878de73-9ebd-4a3e-bea4-ce8bede3383e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:51.040886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7878de73-9ebd-4a3e-bea4-ce8bede3383e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:51.041225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Security group rule updated ['7cfc1ce5-d50d-4d42-a980-57056cde8abd'] Sep 30 09:46:51.041597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Resource SecurityGroupRule deleted: dfff8676-5e99-446c-adc2-d63c4f8c9e65 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:51.042110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (dfff8676-5e99-446c-adc2-d63c4f8c9e65), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:51.042424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2c2531a3-aade-4888-b1d7-c193f8afd756 admin admin] Security group rule updated ['7cfc1ce5-d50d-4d42-a980-57056cde8abd'] Sep 30 09:46:52.160353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:51Z,description='Default security group',id=41d23c9d-3fe5-4b4c-9057-252926139dd6,is_default=True,name='default',project_id='22ab318fbcb645bdafd7522089e44cdb',revision_number=1,rules=[SecurityGroupRule(2a316073-c323-4721-8bc8-39d399f11588),SecurityGroupRule(69ef4ed4-c2e6-4fa1-9fda-4f6e01f48461),SecurityGroupRule(8c531c2f-1b7d-4a3c-8410-1159f40c4f33),SecurityGroupRule(8d2b9010-382b-41d6-aaa4-dd114355d309)],shared=False,stateful=True,updated_at=2022-09-30T09:46:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:52.161005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (41d23c9d-3fe5-4b4c-9057-252926139dd6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.161330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:51Z,description=,direction='ingress',ethertype='IPv4',id=2a316073-c323-4721-8bc8-39d399f11588,normalized_cidr=None,port_range_max=,port_range_min=,project_id='22ab318fbcb645bdafd7522089e44cdb',protocol=,remote_address_group_id=,remote_group_id=41d23c9d-3fe5-4b4c-9057-252926139dd6,remote_ip_prefix=,revision_number=0,security_group_id=41d23c9d-3fe5-4b4c-9057-252926139dd6,updated_at=2022-09-30T09:46:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:52.162351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2a316073-c323-4721-8bc8-39d399f11588), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.162904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Security group rule updated ['41d23c9d-3fe5-4b4c-9057-252926139dd6'] Sep 30 09:46:52.163763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:51Z,description=,direction='ingress',ethertype='IPv6',id=69ef4ed4-c2e6-4fa1-9fda-4f6e01f48461,normalized_cidr=None,port_range_max=,port_range_min=,project_id='22ab318fbcb645bdafd7522089e44cdb',protocol=,remote_address_group_id=,remote_group_id=41d23c9d-3fe5-4b4c-9057-252926139dd6,remote_ip_prefix=,revision_number=0,security_group_id=41d23c9d-3fe5-4b4c-9057-252926139dd6,updated_at=2022-09-30T09:46:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:52.164951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (69ef4ed4-c2e6-4fa1-9fda-4f6e01f48461), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.165797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Security group rule updated ['41d23c9d-3fe5-4b4c-9057-252926139dd6'] Sep 30 09:46:52.166688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:51Z,description=,direction='egress',ethertype='IPv4',id=8c531c2f-1b7d-4a3c-8410-1159f40c4f33,normalized_cidr=None,port_range_max=,port_range_min=,project_id='22ab318fbcb645bdafd7522089e44cdb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=41d23c9d-3fe5-4b4c-9057-252926139dd6,updated_at=2022-09-30T09:46:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:52.167342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8c531c2f-1b7d-4a3c-8410-1159f40c4f33), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.168477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Security group rule updated ['41d23c9d-3fe5-4b4c-9057-252926139dd6'] Sep 30 09:46:52.169745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:51Z,description=,direction='egress',ethertype='IPv6',id=8d2b9010-382b-41d6-aaa4-dd114355d309,normalized_cidr=None,port_range_max=,port_range_min=,project_id='22ab318fbcb645bdafd7522089e44cdb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=41d23c9d-3fe5-4b4c-9057-252926139dd6,updated_at=2022-09-30T09:46:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:52.170899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8d2b9010-382b-41d6-aaa4-dd114355d309), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.171407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0dc808c9-1446-41fa-b365-b25d87d2acd3 admin admin] Security group rule updated ['41d23c9d-3fe5-4b4c-9057-252926139dd6'] Sep 30 09:46:52.252739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:279 started Sep 30 09:46:52.256016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03ba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=756000000,duration_sec=570,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:52.256654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:52.257360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:279 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:46:52.474625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:52Z,description='Default security group',id=a99a98f6-7761-43e1-9ce5-5a1cb5610e42,is_default=True,name='default',project_id='7e9cca2169e84930adf5d41582bc75e0',revision_number=1,rules=[SecurityGroupRule(4086df2d-a065-4cda-b7a6-d4aaaab78a96),SecurityGroupRule(5806b08e-c7ee-44a5-9da8-d313e588ed0b),SecurityGroupRule(70e5558b-7fd5-433d-bd78-8caaf302ef27),SecurityGroupRule(f876ba3c-a3a9-467d-947b-90afff95bb6f)],shared=False,stateful=True,updated_at=2022-09-30T09:46:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:52.474625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (a99a98f6-7761-43e1-9ce5-5a1cb5610e42), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.474625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:52Z,description=,direction='egress',ethertype='IPv6',id=4086df2d-a065-4cda-b7a6-d4aaaab78a96,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e9cca2169e84930adf5d41582bc75e0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a99a98f6-7761-43e1-9ce5-5a1cb5610e42,updated_at=2022-09-30T09:46:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:52.474962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4086df2d-a065-4cda-b7a6-d4aaaab78a96), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.474962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Security group rule updated ['a99a98f6-7761-43e1-9ce5-5a1cb5610e42'] Sep 30 09:46:52.474962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:52Z,description=,direction='ingress',ethertype='IPv6',id=5806b08e-c7ee-44a5-9da8-d313e588ed0b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e9cca2169e84930adf5d41582bc75e0',protocol=,remote_address_group_id=,remote_group_id=a99a98f6-7761-43e1-9ce5-5a1cb5610e42,remote_ip_prefix=,revision_number=0,security_group_id=a99a98f6-7761-43e1-9ce5-5a1cb5610e42,updated_at=2022-09-30T09:46:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:52.474962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5806b08e-c7ee-44a5-9da8-d313e588ed0b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.475303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Security group rule updated ['a99a98f6-7761-43e1-9ce5-5a1cb5610e42'] Sep 30 09:46:52.475303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:52Z,description=,direction='egress',ethertype='IPv4',id=70e5558b-7fd5-433d-bd78-8caaf302ef27,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e9cca2169e84930adf5d41582bc75e0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a99a98f6-7761-43e1-9ce5-5a1cb5610e42,updated_at=2022-09-30T09:46:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:52.475303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (70e5558b-7fd5-433d-bd78-8caaf302ef27), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.475303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Security group rule updated ['a99a98f6-7761-43e1-9ce5-5a1cb5610e42'] Sep 30 09:46:52.475600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:52Z,description=,direction='ingress',ethertype='IPv4',id=f876ba3c-a3a9-467d-947b-90afff95bb6f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e9cca2169e84930adf5d41582bc75e0',protocol=,remote_address_group_id=,remote_group_id=a99a98f6-7761-43e1-9ce5-5a1cb5610e42,remote_ip_prefix=,revision_number=0,security_group_id=a99a98f6-7761-43e1-9ce5-5a1cb5610e42,updated_at=2022-09-30T09:46:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:52.475600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f876ba3c-a3a9-467d-947b-90afff95bb6f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.475888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-24442a27-ed40-4fcb-82da-8454aeae7301 admin admin] Security group rule updated ['a99a98f6-7761-43e1-9ce5-5a1cb5610e42'] Sep 30 09:46:52.483391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Resource SecurityGroup deleted: 41d23c9d-3fe5-4b4c-9057-252926139dd6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:52.483980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (41d23c9d-3fe5-4b4c-9057-252926139dd6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.484619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('41d23c9d-3fe5-4b4c-9057-252926139dd6',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:52.499324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('41d23c9d-3fe5-4b4c-9057-252926139dd6',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:52.500081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Resource SecurityGroupRule deleted: 2a316073-c323-4721-8bc8-39d399f11588 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:52.500667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2a316073-c323-4721-8bc8-39d399f11588), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.501205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Security group rule updated ['41d23c9d-3fe5-4b4c-9057-252926139dd6'] Sep 30 09:46:52.501760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Resource SecurityGroupRule deleted: 69ef4ed4-c2e6-4fa1-9fda-4f6e01f48461 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:52.502340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (69ef4ed4-c2e6-4fa1-9fda-4f6e01f48461), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.502871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Security group rule updated ['41d23c9d-3fe5-4b4c-9057-252926139dd6'] Sep 30 09:46:52.503395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Resource SecurityGroupRule deleted: 8c531c2f-1b7d-4a3c-8410-1159f40c4f33 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:52.503894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8c531c2f-1b7d-4a3c-8410-1159f40c4f33), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.504367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Security group rule updated ['41d23c9d-3fe5-4b4c-9057-252926139dd6'] Sep 30 09:46:52.504902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Resource SecurityGroupRule deleted: 8d2b9010-382b-41d6-aaa4-dd114355d309 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:52.509099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8d2b9010-382b-41d6-aaa4-dd114355d309), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.509099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4cc09ad6-4b29-4642-bd03-1a34993880cc admin admin] Security group rule updated ['41d23c9d-3fe5-4b4c-9057-252926139dd6'] Sep 30 09:46:52.697283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Resource SecurityGroup deleted: a99a98f6-7761-43e1-9ce5-5a1cb5610e42 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:52.697667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (a99a98f6-7761-43e1-9ce5-5a1cb5610e42), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.698126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a99a98f6-7761-43e1-9ce5-5a1cb5610e42',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:52.721320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a99a98f6-7761-43e1-9ce5-5a1cb5610e42',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:52.721864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Resource SecurityGroupRule deleted: 4086df2d-a065-4cda-b7a6-d4aaaab78a96 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:52.722316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4086df2d-a065-4cda-b7a6-d4aaaab78a96), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.723319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Security group rule updated ['a99a98f6-7761-43e1-9ce5-5a1cb5610e42'] Sep 30 09:46:52.723900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Resource SecurityGroupRule deleted: 5806b08e-c7ee-44a5-9da8-d313e588ed0b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:52.725242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5806b08e-c7ee-44a5-9da8-d313e588ed0b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.725749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Security group rule updated ['a99a98f6-7761-43e1-9ce5-5a1cb5610e42'] Sep 30 09:46:52.726292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Resource SecurityGroupRule deleted: 70e5558b-7fd5-433d-bd78-8caaf302ef27 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:52.726673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (70e5558b-7fd5-433d-bd78-8caaf302ef27), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.730910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Security group rule updated ['a99a98f6-7761-43e1-9ce5-5a1cb5610e42'] Sep 30 09:46:52.731299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Resource SecurityGroupRule deleted: f876ba3c-a3a9-467d-947b-90afff95bb6f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:52.731708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f876ba3c-a3a9-467d-947b-90afff95bb6f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:52.732036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a1efd0c0-f929-4567-b817-45801c72b1c7 admin admin] Security group rule updated ['a99a98f6-7761-43e1-9ce5-5a1cb5610e42'] Sep 30 09:46:54.254418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:280 started Sep 30 09:46:54.256714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=757000000,duration_sec=572,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:54.257340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:54.257718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:280 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:46:55.491803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:55Z,description='Default security group',id=ea815d97-d6ee-43ad-b991-32837dbc2387,is_default=True,name='default',project_id='179cdac0ebe64e4ab4c01578c80c7845',revision_number=1,rules=[SecurityGroupRule(3b213eaf-0953-4b4b-bb06-27ab46c354cd),SecurityGroupRule(5af86d5e-16de-4f9e-969d-7d6190621a61),SecurityGroupRule(76b9abdd-2d2b-4741-a7e1-a92e7856e66f),SecurityGroupRule(7ac75bb2-f24b-4e99-b035-278fa1828b23)],shared=False,stateful=True,updated_at=2022-09-30T09:46:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:55.492570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (ea815d97-d6ee-43ad-b991-32837dbc2387), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:55.492747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:55Z,description=,direction='egress',ethertype='IPv4',id=3b213eaf-0953-4b4b-bb06-27ab46c354cd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='179cdac0ebe64e4ab4c01578c80c7845',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ea815d97-d6ee-43ad-b991-32837dbc2387,updated_at=2022-09-30T09:46:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:55.493175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (3b213eaf-0953-4b4b-bb06-27ab46c354cd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:55.493708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Security group rule updated ['ea815d97-d6ee-43ad-b991-32837dbc2387'] Sep 30 09:46:55.494623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:55Z,description=,direction='ingress',ethertype='IPv6',id=5af86d5e-16de-4f9e-969d-7d6190621a61,normalized_cidr=None,port_range_max=,port_range_min=,project_id='179cdac0ebe64e4ab4c01578c80c7845',protocol=,remote_address_group_id=,remote_group_id=ea815d97-d6ee-43ad-b991-32837dbc2387,remote_ip_prefix=,revision_number=0,security_group_id=ea815d97-d6ee-43ad-b991-32837dbc2387,updated_at=2022-09-30T09:46:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:55.495456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5af86d5e-16de-4f9e-969d-7d6190621a61), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:55.495786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Security group rule updated ['ea815d97-d6ee-43ad-b991-32837dbc2387'] Sep 30 09:46:55.496442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:55Z,description=,direction='egress',ethertype='IPv6',id=76b9abdd-2d2b-4741-a7e1-a92e7856e66f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='179cdac0ebe64e4ab4c01578c80c7845',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ea815d97-d6ee-43ad-b991-32837dbc2387,updated_at=2022-09-30T09:46:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:55.496792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (76b9abdd-2d2b-4741-a7e1-a92e7856e66f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:55.497181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Security group rule updated ['ea815d97-d6ee-43ad-b991-32837dbc2387'] Sep 30 09:46:55.497846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:55Z,description=,direction='ingress',ethertype='IPv4',id=7ac75bb2-f24b-4e99-b035-278fa1828b23,normalized_cidr=None,port_range_max=,port_range_min=,project_id='179cdac0ebe64e4ab4c01578c80c7845',protocol=,remote_address_group_id=,remote_group_id=ea815d97-d6ee-43ad-b991-32837dbc2387,remote_ip_prefix=,revision_number=0,security_group_id=ea815d97-d6ee-43ad-b991-32837dbc2387,updated_at=2022-09-30T09:46:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:55.498197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7ac75bb2-f24b-4e99-b035-278fa1828b23), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:55.498520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e0a892a0-67d4-4f0b-b473-26821a554ab1 admin admin] Security group rule updated ['ea815d97-d6ee-43ad-b991-32837dbc2387'] Sep 30 09:46:55.725825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Resource SecurityGroup deleted: ea815d97-d6ee-43ad-b991-32837dbc2387 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:55.726494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (ea815d97-d6ee-43ad-b991-32837dbc2387), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:55.729887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ea815d97-d6ee-43ad-b991-32837dbc2387',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:55.744934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ea815d97-d6ee-43ad-b991-32837dbc2387',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:55.745862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Resource SecurityGroupRule deleted: 3b213eaf-0953-4b4b-bb06-27ab46c354cd {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:55.746437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (3b213eaf-0953-4b4b-bb06-27ab46c354cd), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:55.746824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Security group rule updated ['ea815d97-d6ee-43ad-b991-32837dbc2387'] Sep 30 09:46:55.747389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Resource SecurityGroupRule deleted: 5af86d5e-16de-4f9e-969d-7d6190621a61 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:55.747727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5af86d5e-16de-4f9e-969d-7d6190621a61), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:55.748844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Security group rule updated ['ea815d97-d6ee-43ad-b991-32837dbc2387'] Sep 30 09:46:55.751082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Resource SecurityGroupRule deleted: 76b9abdd-2d2b-4741-a7e1-a92e7856e66f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:55.751549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (76b9abdd-2d2b-4741-a7e1-a92e7856e66f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:55.752057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Security group rule updated ['ea815d97-d6ee-43ad-b991-32837dbc2387'] Sep 30 09:46:55.752601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Resource SecurityGroupRule deleted: 7ac75bb2-f24b-4e99-b035-278fa1828b23 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:55.755852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7ac75bb2-f24b-4e99-b035-278fa1828b23), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:55.761888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2afc38ce-16eb-4896-b8fd-fcbcafeab6b7 admin admin] Security group rule updated ['ea815d97-d6ee-43ad-b991-32837dbc2387'] Sep 30 09:46:56.254843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:281 started Sep 30 09:46:56.257766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03be,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=757000000,duration_sec=574,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:56.258387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:56.258767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:281 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:46:56.672697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:56Z,description='Default security group',id=20ee40cb-4f34-4a6b-ae2f-820628044bf7,is_default=True,name='default',project_id='6c2541f2d9b84a7e8b07e26eab937f72',revision_number=1,rules=[SecurityGroupRule(6da2054d-3ae7-4f71-95ad-d36eee745779),SecurityGroupRule(c2b1e05e-7d06-4b9b-9bdf-97cc8f7262fe),SecurityGroupRule(c89a4c48-db41-4541-abf3-67728164a9f9),SecurityGroupRule(cf5194e2-7c0a-4603-84ec-a14ce209b482)],shared=False,stateful=True,updated_at=2022-09-30T09:46:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:56.673383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (20ee40cb-4f34-4a6b-ae2f-820628044bf7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:56.673689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:56Z,description=,direction='egress',ethertype='IPv6',id=6da2054d-3ae7-4f71-95ad-d36eee745779,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6c2541f2d9b84a7e8b07e26eab937f72',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=20ee40cb-4f34-4a6b-ae2f-820628044bf7,updated_at=2022-09-30T09:46:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:56.674165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (6da2054d-3ae7-4f71-95ad-d36eee745779), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:56.674500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Security group rule updated ['20ee40cb-4f34-4a6b-ae2f-820628044bf7'] Sep 30 09:46:56.675266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:56Z,description=,direction='ingress',ethertype='IPv4',id=c2b1e05e-7d06-4b9b-9bdf-97cc8f7262fe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6c2541f2d9b84a7e8b07e26eab937f72',protocol=,remote_address_group_id=,remote_group_id=20ee40cb-4f34-4a6b-ae2f-820628044bf7,remote_ip_prefix=,revision_number=0,security_group_id=20ee40cb-4f34-4a6b-ae2f-820628044bf7,updated_at=2022-09-30T09:46:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:56.675622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c2b1e05e-7d06-4b9b-9bdf-97cc8f7262fe), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:56.675948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Security group rule updated ['20ee40cb-4f34-4a6b-ae2f-820628044bf7'] Sep 30 09:46:56.676611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:56Z,description=,direction='ingress',ethertype='IPv6',id=c89a4c48-db41-4541-abf3-67728164a9f9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6c2541f2d9b84a7e8b07e26eab937f72',protocol=,remote_address_group_id=,remote_group_id=20ee40cb-4f34-4a6b-ae2f-820628044bf7,remote_ip_prefix=,revision_number=0,security_group_id=20ee40cb-4f34-4a6b-ae2f-820628044bf7,updated_at=2022-09-30T09:46:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:56.676963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c89a4c48-db41-4541-abf3-67728164a9f9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:56.677405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Security group rule updated ['20ee40cb-4f34-4a6b-ae2f-820628044bf7'] Sep 30 09:46:56.678210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:56Z,description=,direction='egress',ethertype='IPv4',id=cf5194e2-7c0a-4603-84ec-a14ce209b482,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6c2541f2d9b84a7e8b07e26eab937f72',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=20ee40cb-4f34-4a6b-ae2f-820628044bf7,updated_at=2022-09-30T09:46:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:56.678565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (cf5194e2-7c0a-4603-84ec-a14ce209b482), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:56.678920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0f5936ab-2d86-48cb-bca6-ce8b0fe882ec admin admin] Security group rule updated ['20ee40cb-4f34-4a6b-ae2f-820628044bf7'] Sep 30 09:46:56.883858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Resource SecurityGroup deleted: 20ee40cb-4f34-4a6b-ae2f-820628044bf7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:56.884452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (20ee40cb-4f34-4a6b-ae2f-820628044bf7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:56.885193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('20ee40cb-4f34-4a6b-ae2f-820628044bf7',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:46:56.907804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('20ee40cb-4f34-4a6b-ae2f-820628044bf7',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:46:56.908257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Resource SecurityGroupRule deleted: 6da2054d-3ae7-4f71-95ad-d36eee745779 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:56.909523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (6da2054d-3ae7-4f71-95ad-d36eee745779), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:56.909874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Security group rule updated ['20ee40cb-4f34-4a6b-ae2f-820628044bf7'] Sep 30 09:46:56.910267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Resource SecurityGroupRule deleted: c2b1e05e-7d06-4b9b-9bdf-97cc8f7262fe {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:56.910643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c2b1e05e-7d06-4b9b-9bdf-97cc8f7262fe), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:56.910971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Security group rule updated ['20ee40cb-4f34-4a6b-ae2f-820628044bf7'] Sep 30 09:46:56.915670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Resource SecurityGroupRule deleted: c89a4c48-db41-4541-abf3-67728164a9f9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:56.920573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c89a4c48-db41-4541-abf3-67728164a9f9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:56.921366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Security group rule updated ['20ee40cb-4f34-4a6b-ae2f-820628044bf7'] Sep 30 09:46:56.921936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Resource SecurityGroupRule deleted: cf5194e2-7c0a-4603-84ec-a14ce209b482 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:46:56.922484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (cf5194e2-7c0a-4603-84ec-a14ce209b482), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:56.923124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f7207427-4617-47db-a025-7c61d5643718 admin admin] Security group rule updated ['20ee40cb-4f34-4a6b-ae2f-820628044bf7'] Sep 30 09:46:58.256021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:282 started Sep 30 09:46:58.259614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03c0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=759000000,duration_sec=576,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:46:58.260239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:46:58.260808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:282 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:46:59.917501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:46:59Z,description='Default security group',id=7ce4af05-85bf-45d5-bef5-4ddf35148d0f,is_default=True,name='default',project_id='02501f755ba54c339a3b8808b8f0820e',revision_number=1,rules=[SecurityGroupRule(36b6699f-b1b5-4c88-80d3-5b9dbd784fda),SecurityGroupRule(4639077b-c9ca-41ef-8d4f-38f9c17230f9),SecurityGroupRule(6939f4a6-2ed5-4bb9-b6dc-503d0ccbdd79),SecurityGroupRule(ea48eab4-9df6-48a3-9626-c526536c67cc)],shared=False,stateful=True,updated_at=2022-09-30T09:46:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:59.918086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (7ce4af05-85bf-45d5-bef5-4ddf35148d0f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:59.918823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:59Z,description=,direction='egress',ethertype='IPv4',id=36b6699f-b1b5-4c88-80d3-5b9dbd784fda,normalized_cidr=None,port_range_max=,port_range_min=,project_id='02501f755ba54c339a3b8808b8f0820e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7ce4af05-85bf-45d5-bef5-4ddf35148d0f,updated_at=2022-09-30T09:46:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:59.918951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (36b6699f-b1b5-4c88-80d3-5b9dbd784fda), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:59.919264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Security group rule updated ['7ce4af05-85bf-45d5-bef5-4ddf35148d0f'] Sep 30 09:46:59.920704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:59Z,description=,direction='ingress',ethertype='IPv4',id=4639077b-c9ca-41ef-8d4f-38f9c17230f9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='02501f755ba54c339a3b8808b8f0820e',protocol=,remote_address_group_id=,remote_group_id=7ce4af05-85bf-45d5-bef5-4ddf35148d0f,remote_ip_prefix=,revision_number=0,security_group_id=7ce4af05-85bf-45d5-bef5-4ddf35148d0f,updated_at=2022-09-30T09:46:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:59.921066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4639077b-c9ca-41ef-8d4f-38f9c17230f9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:59.921394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Security group rule updated ['7ce4af05-85bf-45d5-bef5-4ddf35148d0f'] Sep 30 09:46:59.922047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:59Z,description=,direction='egress',ethertype='IPv6',id=6939f4a6-2ed5-4bb9-b6dc-503d0ccbdd79,normalized_cidr=None,port_range_max=,port_range_min=,project_id='02501f755ba54c339a3b8808b8f0820e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7ce4af05-85bf-45d5-bef5-4ddf35148d0f,updated_at=2022-09-30T09:46:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:59.922397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (6939f4a6-2ed5-4bb9-b6dc-503d0ccbdd79), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:59.923186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Security group rule updated ['7ce4af05-85bf-45d5-bef5-4ddf35148d0f'] Sep 30 09:46:59.923853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:46:59Z,description=,direction='ingress',ethertype='IPv6',id=ea48eab4-9df6-48a3-9626-c526536c67cc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='02501f755ba54c339a3b8808b8f0820e',protocol=,remote_address_group_id=,remote_group_id=7ce4af05-85bf-45d5-bef5-4ddf35148d0f,remote_ip_prefix=,revision_number=0,security_group_id=7ce4af05-85bf-45d5-bef5-4ddf35148d0f,updated_at=2022-09-30T09:46:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:46:59.924263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (ea48eab4-9df6-48a3-9626-c526536c67cc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:46:59.926030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7e1f6c81-2033-4515-92bb-2fcf1f27b047 admin admin] Security group rule updated ['7ce4af05-85bf-45d5-bef5-4ddf35148d0f'] Sep 30 09:47:00.257555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:283 started Sep 30 09:47:00.263108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03c2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=760000000,duration_sec=578,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:00.264111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:00.264473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:283 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:47:00.272186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Resource SecurityGroup deleted: 7ce4af05-85bf-45d5-bef5-4ddf35148d0f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:00.272874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (7ce4af05-85bf-45d5-bef5-4ddf35148d0f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:00.274995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7ce4af05-85bf-45d5-bef5-4ddf35148d0f',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:00.291999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7ce4af05-85bf-45d5-bef5-4ddf35148d0f',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:00.292614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Resource SecurityGroupRule deleted: 36b6699f-b1b5-4c88-80d3-5b9dbd784fda {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:00.293258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (36b6699f-b1b5-4c88-80d3-5b9dbd784fda), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:00.293790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Security group rule updated ['7ce4af05-85bf-45d5-bef5-4ddf35148d0f'] Sep 30 09:47:00.294335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Resource SecurityGroupRule deleted: 4639077b-c9ca-41ef-8d4f-38f9c17230f9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:00.295425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4639077b-c9ca-41ef-8d4f-38f9c17230f9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:00.301323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Security group rule updated ['7ce4af05-85bf-45d5-bef5-4ddf35148d0f'] Sep 30 09:47:00.301751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Resource SecurityGroupRule deleted: 6939f4a6-2ed5-4bb9-b6dc-503d0ccbdd79 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:00.304495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (6939f4a6-2ed5-4bb9-b6dc-503d0ccbdd79), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:00.307174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Security group rule updated ['7ce4af05-85bf-45d5-bef5-4ddf35148d0f'] Sep 30 09:47:00.307174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Resource SecurityGroupRule deleted: ea48eab4-9df6-48a3-9626-c526536c67cc {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:00.307174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (ea48eab4-9df6-48a3-9626-c526536c67cc), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:00.310308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-24ac6904-55db-4913-9a1e-d6a9a67167ff admin admin] Security group rule updated ['7ce4af05-85bf-45d5-bef5-4ddf35148d0f'] Sep 30 09:47:00.948076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:00Z,description='Default security group',id=1b7d3563-c53b-49a4-8e5f-c8114ebb1c06,is_default=True,name='default',project_id='be14f805af7a4180aea48756132410a5',revision_number=1,rules=[SecurityGroupRule(81004a9a-a330-41d7-b656-7b268becc417),SecurityGroupRule(a8f4c2fa-5f8d-4d3d-a733-994468470bce),SecurityGroupRule(b4de5d34-3344-4114-994d-7d4d1f8c9da9),SecurityGroupRule(c15a1bf3-0db4-409f-b089-67cb6be8b05d)],shared=False,stateful=True,updated_at=2022-09-30T09:47:00Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:00.948770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (1b7d3563-c53b-49a4-8e5f-c8114ebb1c06), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:00.949347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:00Z,description=,direction='ingress',ethertype='IPv4',id=81004a9a-a330-41d7-b656-7b268becc417,normalized_cidr=None,port_range_max=,port_range_min=,project_id='be14f805af7a4180aea48756132410a5',protocol=,remote_address_group_id=,remote_group_id=1b7d3563-c53b-49a4-8e5f-c8114ebb1c06,remote_ip_prefix=,revision_number=0,security_group_id=1b7d3563-c53b-49a4-8e5f-c8114ebb1c06,updated_at=2022-09-30T09:47:00Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:00.949827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (81004a9a-a330-41d7-b656-7b268becc417), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:00.950731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Security group rule updated ['1b7d3563-c53b-49a4-8e5f-c8114ebb1c06'] Sep 30 09:47:00.951077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:00Z,description=,direction='egress',ethertype='IPv6',id=a8f4c2fa-5f8d-4d3d-a733-994468470bce,normalized_cidr=None,port_range_max=,port_range_min=,project_id='be14f805af7a4180aea48756132410a5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1b7d3563-c53b-49a4-8e5f-c8114ebb1c06,updated_at=2022-09-30T09:47:00Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:00.951519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a8f4c2fa-5f8d-4d3d-a733-994468470bce), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:00.951962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Security group rule updated ['1b7d3563-c53b-49a4-8e5f-c8114ebb1c06'] Sep 30 09:47:00.952702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:00Z,description=,direction='egress',ethertype='IPv4',id=b4de5d34-3344-4114-994d-7d4d1f8c9da9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='be14f805af7a4180aea48756132410a5',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1b7d3563-c53b-49a4-8e5f-c8114ebb1c06,updated_at=2022-09-30T09:47:00Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:00.953208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b4de5d34-3344-4114-994d-7d4d1f8c9da9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:00.955215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Security group rule updated ['1b7d3563-c53b-49a4-8e5f-c8114ebb1c06'] Sep 30 09:47:00.956017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:00Z,description=,direction='ingress',ethertype='IPv6',id=c15a1bf3-0db4-409f-b089-67cb6be8b05d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='be14f805af7a4180aea48756132410a5',protocol=,remote_address_group_id=,remote_group_id=1b7d3563-c53b-49a4-8e5f-c8114ebb1c06,remote_ip_prefix=,revision_number=0,security_group_id=1b7d3563-c53b-49a4-8e5f-c8114ebb1c06,updated_at=2022-09-30T09:47:00Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:00.957515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c15a1bf3-0db4-409f-b089-67cb6be8b05d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:00.958493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e0f54b75-8fa7-497d-87c1-38a9cb67aaa8 admin admin] Security group rule updated ['1b7d3563-c53b-49a4-8e5f-c8114ebb1c06'] Sep 30 09:47:01.280413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Resource SecurityGroup deleted: 1b7d3563-c53b-49a4-8e5f-c8114ebb1c06 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:01.281286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (1b7d3563-c53b-49a4-8e5f-c8114ebb1c06), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.281960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1b7d3563-c53b-49a4-8e5f-c8114ebb1c06',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:01.296743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1b7d3563-c53b-49a4-8e5f-c8114ebb1c06',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:01.297749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Resource SecurityGroupRule deleted: 81004a9a-a330-41d7-b656-7b268becc417 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:01.298317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (81004a9a-a330-41d7-b656-7b268becc417), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.299415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Security group rule updated ['1b7d3563-c53b-49a4-8e5f-c8114ebb1c06'] Sep 30 09:47:01.299974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Resource SecurityGroupRule deleted: a8f4c2fa-5f8d-4d3d-a733-994468470bce {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:01.300518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a8f4c2fa-5f8d-4d3d-a733-994468470bce), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.301049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Security group rule updated ['1b7d3563-c53b-49a4-8e5f-c8114ebb1c06'] Sep 30 09:47:01.301744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Resource SecurityGroupRule deleted: b4de5d34-3344-4114-994d-7d4d1f8c9da9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:01.302244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b4de5d34-3344-4114-994d-7d4d1f8c9da9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.302835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Security group rule updated ['1b7d3563-c53b-49a4-8e5f-c8114ebb1c06'] Sep 30 09:47:01.303334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Resource SecurityGroupRule deleted: c15a1bf3-0db4-409f-b089-67cb6be8b05d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:01.303813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c15a1bf3-0db4-409f-b089-67cb6be8b05d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.304408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1b710667-5000-46b8-b518-0489aeabc226 admin admin] Security group rule updated ['1b7d3563-c53b-49a4-8e5f-c8114ebb1c06'] Sep 30 09:47:01.463477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:01Z,description='Default security group',id=541f5c2a-a240-4162-83a6-04e73da8ee16,is_default=True,name='default',project_id='f3ce98276abc499fbd2a329e523fa124',revision_number=1,rules=[SecurityGroupRule(397d77f2-7d2a-4fbb-bffe-9b16e3c90e1e),SecurityGroupRule(489779cf-b6e0-484c-9086-4d5bd779a77c),SecurityGroupRule(925fbb31-7cd9-45ce-935b-9c7f09b3bcbe),SecurityGroupRule(ca609f5d-64d1-4dd9-b6e9-67c1d7cf482f)],shared=False,stateful=True,updated_at=2022-09-30T09:47:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:01.463854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (541f5c2a-a240-4162-83a6-04e73da8ee16), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.464645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:01Z,description=,direction='ingress',ethertype='IPv4',id=397d77f2-7d2a-4fbb-bffe-9b16e3c90e1e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f3ce98276abc499fbd2a329e523fa124',protocol=,remote_address_group_id=,remote_group_id=541f5c2a-a240-4162-83a6-04e73da8ee16,remote_ip_prefix=,revision_number=0,security_group_id=541f5c2a-a240-4162-83a6-04e73da8ee16,updated_at=2022-09-30T09:47:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:01.465168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (397d77f2-7d2a-4fbb-bffe-9b16e3c90e1e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.465497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Security group rule updated ['541f5c2a-a240-4162-83a6-04e73da8ee16'] Sep 30 09:47:01.466445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:01Z,description=,direction='egress',ethertype='IPv4',id=489779cf-b6e0-484c-9086-4d5bd779a77c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f3ce98276abc499fbd2a329e523fa124',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=541f5c2a-a240-4162-83a6-04e73da8ee16,updated_at=2022-09-30T09:47:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:01.466798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (489779cf-b6e0-484c-9086-4d5bd779a77c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.467278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Security group rule updated ['541f5c2a-a240-4162-83a6-04e73da8ee16'] Sep 30 09:47:01.467986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:01Z,description=,direction='ingress',ethertype='IPv6',id=925fbb31-7cd9-45ce-935b-9c7f09b3bcbe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f3ce98276abc499fbd2a329e523fa124',protocol=,remote_address_group_id=,remote_group_id=541f5c2a-a240-4162-83a6-04e73da8ee16,remote_ip_prefix=,revision_number=0,security_group_id=541f5c2a-a240-4162-83a6-04e73da8ee16,updated_at=2022-09-30T09:47:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:01.472511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (925fbb31-7cd9-45ce-935b-9c7f09b3bcbe), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.472511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Security group rule updated ['541f5c2a-a240-4162-83a6-04e73da8ee16'] Sep 30 09:47:01.472511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:01Z,description=,direction='egress',ethertype='IPv6',id=ca609f5d-64d1-4dd9-b6e9-67c1d7cf482f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f3ce98276abc499fbd2a329e523fa124',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=541f5c2a-a240-4162-83a6-04e73da8ee16,updated_at=2022-09-30T09:47:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:01.472511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (ca609f5d-64d1-4dd9-b6e9-67c1d7cf482f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.472991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6723d564-563e-4e90-bc90-ef284c623cb9 admin admin] Security group rule updated ['541f5c2a-a240-4162-83a6-04e73da8ee16'] Sep 30 09:47:01.694482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Resource SecurityGroup deleted: 541f5c2a-a240-4162-83a6-04e73da8ee16 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:01.694964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (541f5c2a-a240-4162-83a6-04e73da8ee16), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.695482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('541f5c2a-a240-4162-83a6-04e73da8ee16',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:01.861544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('541f5c2a-a240-4162-83a6-04e73da8ee16',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:01.861544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Resource SecurityGroupRule deleted: 397d77f2-7d2a-4fbb-bffe-9b16e3c90e1e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:01.861544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (397d77f2-7d2a-4fbb-bffe-9b16e3c90e1e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.861544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Security group rule updated ['541f5c2a-a240-4162-83a6-04e73da8ee16'] Sep 30 09:47:01.861544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Resource SecurityGroupRule deleted: 489779cf-b6e0-484c-9086-4d5bd779a77c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:01.862491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (489779cf-b6e0-484c-9086-4d5bd779a77c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.862491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Security group rule updated ['541f5c2a-a240-4162-83a6-04e73da8ee16'] Sep 30 09:47:01.862491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Resource SecurityGroupRule deleted: 925fbb31-7cd9-45ce-935b-9c7f09b3bcbe {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:01.862491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (925fbb31-7cd9-45ce-935b-9c7f09b3bcbe), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.862491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Security group rule updated ['541f5c2a-a240-4162-83a6-04e73da8ee16'] Sep 30 09:47:01.863507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Resource SecurityGroupRule deleted: ca609f5d-64d1-4dd9-b6e9-67c1d7cf482f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:01.863507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (ca609f5d-64d1-4dd9-b6e9-67c1d7cf482f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:01.863507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ef9ca62e-0b3c-4cc8-a1c5-965143117d55 admin admin] Security group rule updated ['541f5c2a-a240-4162-83a6-04e73da8ee16'] Sep 30 09:47:02.258710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:284 started Sep 30 09:47:02.261675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=761000000,duration_sec=580,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:02.262204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:02.262751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:284 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:02.556875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:02Z,description='Default security group',id=0c848f39-8f65-4caf-bb1f-517f51f1c8a0,is_default=True,name='default',project_id='3ab149fcc9c3411f8b3e08ebe2907109',revision_number=1,rules=[SecurityGroupRule(2986ec00-7c9b-460e-b2bc-1fd1e431a61f),SecurityGroupRule(42f4bcbd-8bbf-4846-94a4-63b38d2581cb),SecurityGroupRule(47cee7d8-f177-4c89-8df7-879c124e2501),SecurityGroupRule(63cf91aa-d0de-4d71-9b4d-d9702ee54581)],shared=False,stateful=True,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.557498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (0c848f39-8f65-4caf-bb1f-517f51f1c8a0), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.559146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:02Z,description=,direction='ingress',ethertype='IPv4',id=2986ec00-7c9b-460e-b2bc-1fd1e431a61f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3ab149fcc9c3411f8b3e08ebe2907109',protocol=,remote_address_group_id=,remote_group_id=0c848f39-8f65-4caf-bb1f-517f51f1c8a0,remote_ip_prefix=,revision_number=0,security_group_id=0c848f39-8f65-4caf-bb1f-517f51f1c8a0,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.560136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2986ec00-7c9b-460e-b2bc-1fd1e431a61f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.560840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Security group rule updated ['0c848f39-8f65-4caf-bb1f-517f51f1c8a0'] Sep 30 09:47:02.561740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:02Z,description=,direction='egress',ethertype='IPv6',id=42f4bcbd-8bbf-4846-94a4-63b38d2581cb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3ab149fcc9c3411f8b3e08ebe2907109',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0c848f39-8f65-4caf-bb1f-517f51f1c8a0,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.562364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (42f4bcbd-8bbf-4846-94a4-63b38d2581cb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.562932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Security group rule updated ['0c848f39-8f65-4caf-bb1f-517f51f1c8a0'] Sep 30 09:47:02.564024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:02Z,description=,direction='ingress',ethertype='IPv6',id=47cee7d8-f177-4c89-8df7-879c124e2501,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3ab149fcc9c3411f8b3e08ebe2907109',protocol=,remote_address_group_id=,remote_group_id=0c848f39-8f65-4caf-bb1f-517f51f1c8a0,remote_ip_prefix=,revision_number=0,security_group_id=0c848f39-8f65-4caf-bb1f-517f51f1c8a0,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.564694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (47cee7d8-f177-4c89-8df7-879c124e2501), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.565216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Security group rule updated ['0c848f39-8f65-4caf-bb1f-517f51f1c8a0'] Sep 30 09:47:02.566211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:02Z,description=,direction='egress',ethertype='IPv4',id=63cf91aa-d0de-4d71-9b4d-d9702ee54581,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3ab149fcc9c3411f8b3e08ebe2907109',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0c848f39-8f65-4caf-bb1f-517f51f1c8a0,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.567049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (63cf91aa-d0de-4d71-9b4d-d9702ee54581), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.567646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a14fcc02-72eb-4184-8604-253956015090 admin admin] Security group rule updated ['0c848f39-8f65-4caf-bb1f-517f51f1c8a0'] Sep 30 09:47:02.624726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:02Z,description='Default security group',id=070dd002-6b29-4979-b1c8-12a3fdbe26d1,is_default=True,name='default',project_id='a0b1b0614863438c99c08917ec713768',revision_number=1,rules=[SecurityGroupRule(181c63e8-5f93-4570-8681-8a340af902e5),SecurityGroupRule(35c6550a-d5b0-4565-b266-132ebbb1ee91),SecurityGroupRule(bd59899e-13d3-4a48-b612-c1795b467bc8),SecurityGroupRule(eb776dcc-6501-4d92-ac7b-3aed6caa0509)],shared=False,stateful=True,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.625103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (070dd002-6b29-4979-b1c8-12a3fdbe26d1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.625725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:02Z,description=,direction='ingress',ethertype='IPv6',id=181c63e8-5f93-4570-8681-8a340af902e5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0b1b0614863438c99c08917ec713768',protocol=,remote_address_group_id=,remote_group_id=070dd002-6b29-4979-b1c8-12a3fdbe26d1,remote_ip_prefix=,revision_number=0,security_group_id=070dd002-6b29-4979-b1c8-12a3fdbe26d1,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.626085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (181c63e8-5f93-4570-8681-8a340af902e5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.626436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Security group rule updated ['070dd002-6b29-4979-b1c8-12a3fdbe26d1'] Sep 30 09:47:02.627137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:02Z,description=,direction='egress',ethertype='IPv4',id=35c6550a-d5b0-4565-b266-132ebbb1ee91,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0b1b0614863438c99c08917ec713768',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=070dd002-6b29-4979-b1c8-12a3fdbe26d1,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.629179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (35c6550a-d5b0-4565-b266-132ebbb1ee91), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.629179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Security group rule updated ['070dd002-6b29-4979-b1c8-12a3fdbe26d1'] Sep 30 09:47:02.629179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:02Z,description=,direction='ingress',ethertype='IPv4',id=bd59899e-13d3-4a48-b612-c1795b467bc8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0b1b0614863438c99c08917ec713768',protocol=,remote_address_group_id=,remote_group_id=070dd002-6b29-4979-b1c8-12a3fdbe26d1,remote_ip_prefix=,revision_number=0,security_group_id=070dd002-6b29-4979-b1c8-12a3fdbe26d1,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.629179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (bd59899e-13d3-4a48-b612-c1795b467bc8), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.629524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Security group rule updated ['070dd002-6b29-4979-b1c8-12a3fdbe26d1'] Sep 30 09:47:02.629895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:02Z,description=,direction='egress',ethertype='IPv6',id=eb776dcc-6501-4d92-ac7b-3aed6caa0509,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a0b1b0614863438c99c08917ec713768',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=070dd002-6b29-4979-b1c8-12a3fdbe26d1,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.630249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (eb776dcc-6501-4d92-ac7b-3aed6caa0509), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.630572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-04848394-a297-4723-9960-25beb32ddabe admin admin] Security group rule updated ['070dd002-6b29-4979-b1c8-12a3fdbe26d1'] Sep 30 09:47:02.701755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:02Z,description='Default security group',id=0a02775d-2c42-4aad-9bc6-9cd924645b7e,is_default=True,name='default',project_id='e642241b30124f0cbf0fe8d9d67d8f47',revision_number=1,rules=[SecurityGroupRule(0315257c-8252-4b26-8ba0-700f3785ecd8),SecurityGroupRule(157b0adb-71bd-4b7d-91ba-ae34405655a4),SecurityGroupRule(465f4151-8e31-40e5-84b6-560cb5f9ed15),SecurityGroupRule(9b2fd44b-5a80-4dc1-bafb-66d792ce620c)],shared=False,stateful=True,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.703234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (0a02775d-2c42-4aad-9bc6-9cd924645b7e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.704209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:02Z,description=,direction='ingress',ethertype='IPv6',id=0315257c-8252-4b26-8ba0-700f3785ecd8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e642241b30124f0cbf0fe8d9d67d8f47',protocol=,remote_address_group_id=,remote_group_id=0a02775d-2c42-4aad-9bc6-9cd924645b7e,remote_ip_prefix=,revision_number=0,security_group_id=0a02775d-2c42-4aad-9bc6-9cd924645b7e,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.704853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (0315257c-8252-4b26-8ba0-700f3785ecd8), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.705469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Security group rule updated ['0a02775d-2c42-4aad-9bc6-9cd924645b7e'] Sep 30 09:47:02.706537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:02Z,description=,direction='ingress',ethertype='IPv4',id=157b0adb-71bd-4b7d-91ba-ae34405655a4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e642241b30124f0cbf0fe8d9d67d8f47',protocol=,remote_address_group_id=,remote_group_id=0a02775d-2c42-4aad-9bc6-9cd924645b7e,remote_ip_prefix=,revision_number=0,security_group_id=0a02775d-2c42-4aad-9bc6-9cd924645b7e,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.707159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (157b0adb-71bd-4b7d-91ba-ae34405655a4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.707685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Security group rule updated ['0a02775d-2c42-4aad-9bc6-9cd924645b7e'] Sep 30 09:47:02.710835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:02Z,description=,direction='egress',ethertype='IPv6',id=465f4151-8e31-40e5-84b6-560cb5f9ed15,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e642241b30124f0cbf0fe8d9d67d8f47',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0a02775d-2c42-4aad-9bc6-9cd924645b7e,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.714305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (465f4151-8e31-40e5-84b6-560cb5f9ed15), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.714305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Security group rule updated ['0a02775d-2c42-4aad-9bc6-9cd924645b7e'] Sep 30 09:47:02.714305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:02Z,description=,direction='egress',ethertype='IPv4',id=9b2fd44b-5a80-4dc1-bafb-66d792ce620c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e642241b30124f0cbf0fe8d9d67d8f47',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0a02775d-2c42-4aad-9bc6-9cd924645b7e,updated_at=2022-09-30T09:47:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:02.714305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (9b2fd44b-5a80-4dc1-bafb-66d792ce620c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.714835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b39e4cd1-5ade-482c-86c8-e5dd2eb095ea admin admin] Security group rule updated ['0a02775d-2c42-4aad-9bc6-9cd924645b7e'] Sep 30 09:47:02.859967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Resource SecurityGroup deleted: 0c848f39-8f65-4caf-bb1f-517f51f1c8a0 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.860614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (0c848f39-8f65-4caf-bb1f-517f51f1c8a0), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.861554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0c848f39-8f65-4caf-bb1f-517f51f1c8a0',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:02.878041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Resource SecurityGroup deleted: 070dd002-6b29-4979-b1c8-12a3fdbe26d1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.878425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (070dd002-6b29-4979-b1c8-12a3fdbe26d1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.878949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('070dd002-6b29-4979-b1c8-12a3fdbe26d1',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:02.881348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0c848f39-8f65-4caf-bb1f-517f51f1c8a0',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:02.882137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Resource SecurityGroupRule deleted: 2986ec00-7c9b-460e-b2bc-1fd1e431a61f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.882498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2986ec00-7c9b-460e-b2bc-1fd1e431a61f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.882875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Security group rule updated ['0c848f39-8f65-4caf-bb1f-517f51f1c8a0'] Sep 30 09:47:02.883263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Resource SecurityGroupRule deleted: 42f4bcbd-8bbf-4846-94a4-63b38d2581cb {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.883616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (42f4bcbd-8bbf-4846-94a4-63b38d2581cb), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.883939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Security group rule updated ['0c848f39-8f65-4caf-bb1f-517f51f1c8a0'] Sep 30 09:47:02.884314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Resource SecurityGroupRule deleted: 47cee7d8-f177-4c89-8df7-879c124e2501 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.885143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (47cee7d8-f177-4c89-8df7-879c124e2501), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.885641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Security group rule updated ['0c848f39-8f65-4caf-bb1f-517f51f1c8a0'] Sep 30 09:47:02.886017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Resource SecurityGroupRule deleted: 63cf91aa-d0de-4d71-9b4d-d9702ee54581 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.886363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (63cf91aa-d0de-4d71-9b4d-d9702ee54581), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.886707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-680a6735-028f-46a5-8185-5363a79cf8aa admin admin] Security group rule updated ['0c848f39-8f65-4caf-bb1f-517f51f1c8a0'] Sep 30 09:47:02.900627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('070dd002-6b29-4979-b1c8-12a3fdbe26d1',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:02.901083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Resource SecurityGroupRule deleted: 181c63e8-5f93-4570-8681-8a340af902e5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.901446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (181c63e8-5f93-4570-8681-8a340af902e5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.901772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Security group rule updated ['070dd002-6b29-4979-b1c8-12a3fdbe26d1'] Sep 30 09:47:02.902295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Resource SecurityGroupRule deleted: 35c6550a-d5b0-4565-b266-132ebbb1ee91 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.902678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (35c6550a-d5b0-4565-b266-132ebbb1ee91), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.903009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Security group rule updated ['070dd002-6b29-4979-b1c8-12a3fdbe26d1'] Sep 30 09:47:02.903361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Resource SecurityGroupRule deleted: bd59899e-13d3-4a48-b612-c1795b467bc8 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.903757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (bd59899e-13d3-4a48-b612-c1795b467bc8), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.904104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Security group rule updated ['070dd002-6b29-4979-b1c8-12a3fdbe26d1'] Sep 30 09:47:02.904570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Resource SecurityGroupRule deleted: eb776dcc-6501-4d92-ac7b-3aed6caa0509 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.904791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (eb776dcc-6501-4d92-ac7b-3aed6caa0509), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.905104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a43f52e6-b23f-46a3-8166-492a32418dbe admin admin] Security group rule updated ['070dd002-6b29-4979-b1c8-12a3fdbe26d1'] Sep 30 09:47:02.907834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Resource SecurityGroup deleted: 0a02775d-2c42-4aad-9bc6-9cd924645b7e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.908184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (0a02775d-2c42-4aad-9bc6-9cd924645b7e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.908629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0a02775d-2c42-4aad-9bc6-9cd924645b7e',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:02.920493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0a02775d-2c42-4aad-9bc6-9cd924645b7e',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:02.924728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Resource SecurityGroupRule deleted: 0315257c-8252-4b26-8ba0-700f3785ecd8 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.924728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (0315257c-8252-4b26-8ba0-700f3785ecd8), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.924728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Security group rule updated ['0a02775d-2c42-4aad-9bc6-9cd924645b7e'] Sep 30 09:47:02.924728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Resource SecurityGroupRule deleted: 157b0adb-71bd-4b7d-91ba-ae34405655a4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.924728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (157b0adb-71bd-4b7d-91ba-ae34405655a4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.925171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Security group rule updated ['0a02775d-2c42-4aad-9bc6-9cd924645b7e'] Sep 30 09:47:02.925171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Resource SecurityGroupRule deleted: 465f4151-8e31-40e5-84b6-560cb5f9ed15 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.925171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (465f4151-8e31-40e5-84b6-560cb5f9ed15), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.925171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Security group rule updated ['0a02775d-2c42-4aad-9bc6-9cd924645b7e'] Sep 30 09:47:02.925171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Resource SecurityGroupRule deleted: 9b2fd44b-5a80-4dc1-bafb-66d792ce620c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:02.925558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (9b2fd44b-5a80-4dc1-bafb-66d792ce620c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:02.925558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d1945fca-1e3f-4b1a-bd4e-8e9a302cae50 admin admin] Security group rule updated ['0a02775d-2c42-4aad-9bc6-9cd924645b7e'] Sep 30 09:47:03.165070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:02Z,description='Default security group',id=c56ec7ba-5c38-493a-b803-d9cb1c40c321,is_default=True,name='default',project_id='d38d518c11a34ffc8921d4c241b8ce06',revision_number=1,rules=[SecurityGroupRule(4cf4ceb0-6de9-4c69-a845-43838450bb22),SecurityGroupRule(931d741b-5143-4070-88cd-e66f89745859),SecurityGroupRule(b5103209-6551-436b-b75c-9a65d7f2e4fb),SecurityGroupRule(e8017f49-a5da-4009-8b21-60032b34257e)],shared=False,stateful=True,updated_at=2022-09-30T09:47:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:03.173687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (c56ec7ba-5c38-493a-b803-d9cb1c40c321), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.173687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:03Z,description=,direction='ingress',ethertype='IPv6',id=4cf4ceb0-6de9-4c69-a845-43838450bb22,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d38d518c11a34ffc8921d4c241b8ce06',protocol=,remote_address_group_id=,remote_group_id=c56ec7ba-5c38-493a-b803-d9cb1c40c321,remote_ip_prefix=,revision_number=0,security_group_id=c56ec7ba-5c38-493a-b803-d9cb1c40c321,updated_at=2022-09-30T09:47:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:03.173687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4cf4ceb0-6de9-4c69-a845-43838450bb22), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.173687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Security group rule updated ['c56ec7ba-5c38-493a-b803-d9cb1c40c321'] Sep 30 09:47:03.174157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:03Z,description=,direction='egress',ethertype='IPv4',id=931d741b-5143-4070-88cd-e66f89745859,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d38d518c11a34ffc8921d4c241b8ce06',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c56ec7ba-5c38-493a-b803-d9cb1c40c321,updated_at=2022-09-30T09:47:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:03.174157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (931d741b-5143-4070-88cd-e66f89745859), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.174157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Security group rule updated ['c56ec7ba-5c38-493a-b803-d9cb1c40c321'] Sep 30 09:47:03.174394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:03Z,description=,direction='egress',ethertype='IPv6',id=b5103209-6551-436b-b75c-9a65d7f2e4fb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d38d518c11a34ffc8921d4c241b8ce06',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c56ec7ba-5c38-493a-b803-d9cb1c40c321,updated_at=2022-09-30T09:47:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:03.174394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b5103209-6551-436b-b75c-9a65d7f2e4fb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.174394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Security group rule updated ['c56ec7ba-5c38-493a-b803-d9cb1c40c321'] Sep 30 09:47:03.174628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:03Z,description=,direction='ingress',ethertype='IPv4',id=e8017f49-a5da-4009-8b21-60032b34257e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d38d518c11a34ffc8921d4c241b8ce06',protocol=,remote_address_group_id=,remote_group_id=c56ec7ba-5c38-493a-b803-d9cb1c40c321,remote_ip_prefix=,revision_number=0,security_group_id=c56ec7ba-5c38-493a-b803-d9cb1c40c321,updated_at=2022-09-30T09:47:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:03.174628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e8017f49-a5da-4009-8b21-60032b34257e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.174628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cf01e4b6-4cf9-4f48-8edd-d159e085c6f1 admin admin] Security group rule updated ['c56ec7ba-5c38-493a-b803-d9cb1c40c321'] Sep 30 09:47:03.371280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Resource SecurityGroup deleted: c56ec7ba-5c38-493a-b803-d9cb1c40c321 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:03.371817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (c56ec7ba-5c38-493a-b803-d9cb1c40c321), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.372077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c56ec7ba-5c38-493a-b803-d9cb1c40c321',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:03.388436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c56ec7ba-5c38-493a-b803-d9cb1c40c321',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:03.389058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Resource SecurityGroupRule deleted: 4cf4ceb0-6de9-4c69-a845-43838450bb22 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:03.389760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4cf4ceb0-6de9-4c69-a845-43838450bb22), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.390115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Security group rule updated ['c56ec7ba-5c38-493a-b803-d9cb1c40c321'] Sep 30 09:47:03.390511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Resource SecurityGroupRule deleted: 931d741b-5143-4070-88cd-e66f89745859 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:03.390905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (931d741b-5143-4070-88cd-e66f89745859), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.391223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Security group rule updated ['c56ec7ba-5c38-493a-b803-d9cb1c40c321'] Sep 30 09:47:03.391586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Resource SecurityGroupRule deleted: b5103209-6551-436b-b75c-9a65d7f2e4fb {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:03.391969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b5103209-6551-436b-b75c-9a65d7f2e4fb), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.392285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Security group rule updated ['c56ec7ba-5c38-493a-b803-d9cb1c40c321'] Sep 30 09:47:03.392648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Resource SecurityGroupRule deleted: e8017f49-a5da-4009-8b21-60032b34257e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:03.392986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e8017f49-a5da-4009-8b21-60032b34257e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.393297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-05f5eb1b-d11b-4118-908e-ca18bd37adc8 admin admin] Security group rule updated ['c56ec7ba-5c38-493a-b803-d9cb1c40c321'] Sep 30 09:47:03.949379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:03Z,description='Default security group',id=0d836258-d27d-4ce1-82b0-08e38109fe4a,is_default=True,name='default',project_id='fc07a91eb5904acaa15d88b72883af30',revision_number=1,rules=[SecurityGroupRule(2a926323-fa01-4892-b5d2-06f3800b3c92),SecurityGroupRule(5d8065b8-6fc4-4dc2-9f4d-8ed5e176bf51),SecurityGroupRule(a7941a20-0716-4bab-bd37-b467e761af85),SecurityGroupRule(e065ae3c-74ae-4682-aa19-1984a8095e6c)],shared=False,stateful=True,updated_at=2022-09-30T09:47:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:03.949963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (0d836258-d27d-4ce1-82b0-08e38109fe4a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.950622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:03Z,description=,direction='ingress',ethertype='IPv6',id=2a926323-fa01-4892-b5d2-06f3800b3c92,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fc07a91eb5904acaa15d88b72883af30',protocol=,remote_address_group_id=,remote_group_id=0d836258-d27d-4ce1-82b0-08e38109fe4a,remote_ip_prefix=,revision_number=0,security_group_id=0d836258-d27d-4ce1-82b0-08e38109fe4a,updated_at=2022-09-30T09:47:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:03.951488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2a926323-fa01-4892-b5d2-06f3800b3c92), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.952082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Security group rule updated ['0d836258-d27d-4ce1-82b0-08e38109fe4a'] Sep 30 09:47:03.952918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:03Z,description=,direction='egress',ethertype='IPv6',id=5d8065b8-6fc4-4dc2-9f4d-8ed5e176bf51,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fc07a91eb5904acaa15d88b72883af30',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0d836258-d27d-4ce1-82b0-08e38109fe4a,updated_at=2022-09-30T09:47:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:03.953275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5d8065b8-6fc4-4dc2-9f4d-8ed5e176bf51), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.953719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Security group rule updated ['0d836258-d27d-4ce1-82b0-08e38109fe4a'] Sep 30 09:47:03.957517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:03Z,description=,direction='egress',ethertype='IPv4',id=a7941a20-0716-4bab-bd37-b467e761af85,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fc07a91eb5904acaa15d88b72883af30',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0d836258-d27d-4ce1-82b0-08e38109fe4a,updated_at=2022-09-30T09:47:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:03.957517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a7941a20-0716-4bab-bd37-b467e761af85), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.957517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Security group rule updated ['0d836258-d27d-4ce1-82b0-08e38109fe4a'] Sep 30 09:47:03.957801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:03Z,description=,direction='ingress',ethertype='IPv4',id=e065ae3c-74ae-4682-aa19-1984a8095e6c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fc07a91eb5904acaa15d88b72883af30',protocol=,remote_address_group_id=,remote_group_id=0d836258-d27d-4ce1-82b0-08e38109fe4a,remote_ip_prefix=,revision_number=0,security_group_id=0d836258-d27d-4ce1-82b0-08e38109fe4a,updated_at=2022-09-30T09:47:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:03.957801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e065ae3c-74ae-4682-aa19-1984a8095e6c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:03.957801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ce40036b-46cd-4181-ada8-a6dbc39232d5 admin admin] Security group rule updated ['0d836258-d27d-4ce1-82b0-08e38109fe4a'] Sep 30 09:47:04.164245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Resource SecurityGroup deleted: 0d836258-d27d-4ce1-82b0-08e38109fe4a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:04.164616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (0d836258-d27d-4ce1-82b0-08e38109fe4a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.165068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0d836258-d27d-4ce1-82b0-08e38109fe4a',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:04.196986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0d836258-d27d-4ce1-82b0-08e38109fe4a',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:04.196986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Resource SecurityGroupRule deleted: 2a926323-fa01-4892-b5d2-06f3800b3c92 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:04.196986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2a926323-fa01-4892-b5d2-06f3800b3c92), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.196986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Security group rule updated ['0d836258-d27d-4ce1-82b0-08e38109fe4a'] Sep 30 09:47:04.196986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Resource SecurityGroupRule deleted: 5d8065b8-6fc4-4dc2-9f4d-8ed5e176bf51 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:04.197546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5d8065b8-6fc4-4dc2-9f4d-8ed5e176bf51), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.197546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Security group rule updated ['0d836258-d27d-4ce1-82b0-08e38109fe4a'] Sep 30 09:47:04.197546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Resource SecurityGroupRule deleted: a7941a20-0716-4bab-bd37-b467e761af85 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:04.197546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a7941a20-0716-4bab-bd37-b467e761af85), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.197546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Security group rule updated ['0d836258-d27d-4ce1-82b0-08e38109fe4a'] Sep 30 09:47:04.198093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Resource SecurityGroupRule deleted: e065ae3c-74ae-4682-aa19-1984a8095e6c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:04.198093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e065ae3c-74ae-4682-aa19-1984a8095e6c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.198093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e0b10902-bd30-4b80-9afc-58f1a47ce93a admin admin] Security group rule updated ['0d836258-d27d-4ce1-82b0-08e38109fe4a'] Sep 30 09:47:04.259920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:285 started Sep 30 09:47:04.265170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03c6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=763000000,duration_sec=582,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:04.266350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:04.266999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:285 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:47:04.433050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:04Z,description='Default security group',id=15c67fbd-4c15-4ca8-a9a8-db4e85a5def1,is_default=True,name='default',project_id='48eb6d0c3f1f4cf98dd5707729fcf461',revision_number=1,rules=[SecurityGroupRule(1a96822a-1e02-4281-ae05-73ba930e36ee),SecurityGroupRule(5b727067-ac29-43ab-bfea-b154628bb50e),SecurityGroupRule(a882de79-4aa8-46ba-851b-632528c1d60b),SecurityGroupRule(d038745d-06ef-4b7f-a7d3-0a6f1c9ba0d4)],shared=False,stateful=True,updated_at=2022-09-30T09:47:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:04.433050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (15c67fbd-4c15-4ca8-a9a8-db4e85a5def1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.433050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:04Z,description=,direction='egress',ethertype='IPv6',id=1a96822a-1e02-4281-ae05-73ba930e36ee,normalized_cidr=None,port_range_max=,port_range_min=,project_id='48eb6d0c3f1f4cf98dd5707729fcf461',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=15c67fbd-4c15-4ca8-a9a8-db4e85a5def1,updated_at=2022-09-30T09:47:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:04.433746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (1a96822a-1e02-4281-ae05-73ba930e36ee), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.433746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Security group rule updated ['15c67fbd-4c15-4ca8-a9a8-db4e85a5def1'] Sep 30 09:47:04.433746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:04Z,description=,direction='egress',ethertype='IPv4',id=5b727067-ac29-43ab-bfea-b154628bb50e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='48eb6d0c3f1f4cf98dd5707729fcf461',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=15c67fbd-4c15-4ca8-a9a8-db4e85a5def1,updated_at=2022-09-30T09:47:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:04.434050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5b727067-ac29-43ab-bfea-b154628bb50e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.439527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Security group rule updated ['15c67fbd-4c15-4ca8-a9a8-db4e85a5def1'] Sep 30 09:47:04.442313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:04Z,description=,direction='ingress',ethertype='IPv6',id=a882de79-4aa8-46ba-851b-632528c1d60b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='48eb6d0c3f1f4cf98dd5707729fcf461',protocol=,remote_address_group_id=,remote_group_id=15c67fbd-4c15-4ca8-a9a8-db4e85a5def1,remote_ip_prefix=,revision_number=0,security_group_id=15c67fbd-4c15-4ca8-a9a8-db4e85a5def1,updated_at=2022-09-30T09:47:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:04.442716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a882de79-4aa8-46ba-851b-632528c1d60b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.443053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Security group rule updated ['15c67fbd-4c15-4ca8-a9a8-db4e85a5def1'] Sep 30 09:47:04.443709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:04Z,description=,direction='ingress',ethertype='IPv4',id=d038745d-06ef-4b7f-a7d3-0a6f1c9ba0d4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='48eb6d0c3f1f4cf98dd5707729fcf461',protocol=,remote_address_group_id=,remote_group_id=15c67fbd-4c15-4ca8-a9a8-db4e85a5def1,remote_ip_prefix=,revision_number=0,security_group_id=15c67fbd-4c15-4ca8-a9a8-db4e85a5def1,updated_at=2022-09-30T09:47:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:04.444056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d038745d-06ef-4b7f-a7d3-0a6f1c9ba0d4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.444433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-80ffb73b-16ac-4313-b916-e752fe281b8c admin admin] Security group rule updated ['15c67fbd-4c15-4ca8-a9a8-db4e85a5def1'] Sep 30 09:47:04.687210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Resource SecurityGroup deleted: 15c67fbd-4c15-4ca8-a9a8-db4e85a5def1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:04.687586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (15c67fbd-4c15-4ca8-a9a8-db4e85a5def1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.688044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('15c67fbd-4c15-4ca8-a9a8-db4e85a5def1',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:04.700198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('15c67fbd-4c15-4ca8-a9a8-db4e85a5def1',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:04.700663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Resource SecurityGroupRule deleted: 1a96822a-1e02-4281-ae05-73ba930e36ee {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:04.701033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (1a96822a-1e02-4281-ae05-73ba930e36ee), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.701375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Security group rule updated ['15c67fbd-4c15-4ca8-a9a8-db4e85a5def1'] Sep 30 09:47:04.701760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Resource SecurityGroupRule deleted: 5b727067-ac29-43ab-bfea-b154628bb50e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:04.702100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5b727067-ac29-43ab-bfea-b154628bb50e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.702778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Security group rule updated ['15c67fbd-4c15-4ca8-a9a8-db4e85a5def1'] Sep 30 09:47:04.703149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Resource SecurityGroupRule deleted: a882de79-4aa8-46ba-851b-632528c1d60b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:04.703518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a882de79-4aa8-46ba-851b-632528c1d60b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.703837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Security group rule updated ['15c67fbd-4c15-4ca8-a9a8-db4e85a5def1'] Sep 30 09:47:04.704204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Resource SecurityGroupRule deleted: d038745d-06ef-4b7f-a7d3-0a6f1c9ba0d4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:04.704544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d038745d-06ef-4b7f-a7d3-0a6f1c9ba0d4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.704858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-188907ce-9538-434d-94fd-1163accdd3e2 admin admin] Security group rule updated ['15c67fbd-4c15-4ca8-a9a8-db4e85a5def1'] Sep 30 09:47:04.774333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:04Z,description='Default security group',id=758f2bf0-120e-49b1-8b17-837b6fc91510,is_default=True,name='default',project_id='32153e84064043b8aaff202896b8d86c',revision_number=1,rules=[SecurityGroupRule(00656d61-5249-4e1d-a4d1-3c667164a0ed),SecurityGroupRule(d92e953e-97f0-4c0f-ac35-b6b738c336d4),SecurityGroupRule(f62d549d-228c-4ec0-8731-fe9cb87ad9e9),SecurityGroupRule(f8ed45be-fe75-49f1-8b92-03b579377a29)],shared=False,stateful=True,updated_at=2022-09-30T09:47:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:04.779768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (758f2bf0-120e-49b1-8b17-837b6fc91510), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.779768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:04Z,description=,direction='ingress',ethertype='IPv6',id=00656d61-5249-4e1d-a4d1-3c667164a0ed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='32153e84064043b8aaff202896b8d86c',protocol=,remote_address_group_id=,remote_group_id=758f2bf0-120e-49b1-8b17-837b6fc91510,remote_ip_prefix=,revision_number=0,security_group_id=758f2bf0-120e-49b1-8b17-837b6fc91510,updated_at=2022-09-30T09:47:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:04.779768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (00656d61-5249-4e1d-a4d1-3c667164a0ed), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.779768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Security group rule updated ['758f2bf0-120e-49b1-8b17-837b6fc91510'] Sep 30 09:47:04.780132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:04Z,description=,direction='egress',ethertype='IPv6',id=d92e953e-97f0-4c0f-ac35-b6b738c336d4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='32153e84064043b8aaff202896b8d86c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=758f2bf0-120e-49b1-8b17-837b6fc91510,updated_at=2022-09-30T09:47:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:04.780132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d92e953e-97f0-4c0f-ac35-b6b738c336d4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.780132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Security group rule updated ['758f2bf0-120e-49b1-8b17-837b6fc91510'] Sep 30 09:47:04.780342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:04Z,description=,direction='egress',ethertype='IPv4',id=f62d549d-228c-4ec0-8731-fe9cb87ad9e9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='32153e84064043b8aaff202896b8d86c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=758f2bf0-120e-49b1-8b17-837b6fc91510,updated_at=2022-09-30T09:47:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:04.780816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f62d549d-228c-4ec0-8731-fe9cb87ad9e9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.781668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Security group rule updated ['758f2bf0-120e-49b1-8b17-837b6fc91510'] Sep 30 09:47:04.782863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:04Z,description=,direction='ingress',ethertype='IPv4',id=f8ed45be-fe75-49f1-8b92-03b579377a29,normalized_cidr=None,port_range_max=,port_range_min=,project_id='32153e84064043b8aaff202896b8d86c',protocol=,remote_address_group_id=,remote_group_id=758f2bf0-120e-49b1-8b17-837b6fc91510,remote_ip_prefix=,revision_number=0,security_group_id=758f2bf0-120e-49b1-8b17-837b6fc91510,updated_at=2022-09-30T09:47:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:04.783609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f8ed45be-fe75-49f1-8b92-03b579377a29), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:04.785109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d2b500ac-527f-4155-b89a-245cfe9da892 admin admin] Security group rule updated ['758f2bf0-120e-49b1-8b17-837b6fc91510'] Sep 30 09:47:05.017404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Resource SecurityGroup deleted: 758f2bf0-120e-49b1-8b17-837b6fc91510 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:05.017953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (758f2bf0-120e-49b1-8b17-837b6fc91510), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:05.018793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('758f2bf0-120e-49b1-8b17-837b6fc91510',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:05.032204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('758f2bf0-120e-49b1-8b17-837b6fc91510',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:05.036504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Resource SecurityGroupRule deleted: 00656d61-5249-4e1d-a4d1-3c667164a0ed {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:05.036504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (00656d61-5249-4e1d-a4d1-3c667164a0ed), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:05.036504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Security group rule updated ['758f2bf0-120e-49b1-8b17-837b6fc91510'] Sep 30 09:47:05.036504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Resource SecurityGroupRule deleted: d92e953e-97f0-4c0f-ac35-b6b738c336d4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:05.036504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d92e953e-97f0-4c0f-ac35-b6b738c336d4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:05.036943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Security group rule updated ['758f2bf0-120e-49b1-8b17-837b6fc91510'] Sep 30 09:47:05.036943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Resource SecurityGroupRule deleted: f62d549d-228c-4ec0-8731-fe9cb87ad9e9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:05.036943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f62d549d-228c-4ec0-8731-fe9cb87ad9e9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:05.036943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Security group rule updated ['758f2bf0-120e-49b1-8b17-837b6fc91510'] Sep 30 09:47:05.036943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Resource SecurityGroupRule deleted: f8ed45be-fe75-49f1-8b92-03b579377a29 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:05.037317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f8ed45be-fe75-49f1-8b92-03b579377a29), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:05.037317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-253097a5-721d-434c-b1da-95d28cb460fa admin admin] Security group rule updated ['758f2bf0-120e-49b1-8b17-837b6fc91510'] Sep 30 09:47:06.263256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:286 started Sep 30 09:47:06.266132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=766000000,duration_sec=584,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:06.267057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:06.267666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:286 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:47:08.264618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:287 started Sep 30 09:47:08.267220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=767000000,duration_sec=586,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:08.268174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:08.268620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:287 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:10.266120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:288 started Sep 30 09:47:10.269182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=769000000,duration_sec=588,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:10.269797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:10.270148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:288 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:12.266921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:289 started Sep 30 09:47:12.269327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=769000000,duration_sec=590,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:12.269888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:12.270234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:289 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:13.896101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9b72c416-0593-4f20-bb00-cd0eba909480 tempest-DeleteServersTestJSON-1102723588 tempest-DeleteServersTestJSON-1102723588-project] Resource Port deleted: 8588e984-7119-40f8-9e2a-800c04c4c6aa {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:13.896101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9b72c416-0593-4f20-bb00-cd0eba909480 tempest-DeleteServersTestJSON-1102723588 tempest-DeleteServersTestJSON-1102723588-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (8588e984-7119-40f8-9e2a-800c04c4c6aa), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:13.896101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9b72c416-0593-4f20-bb00-cd0eba909480 tempest-DeleteServersTestJSON-1102723588 tempest-DeleteServersTestJSON-1102723588-project] Security group member updated {'36a8dc30-8d9a-4b94-899b-74bfa1118bd6'} Sep 30 09:47:14.267963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:290 started Sep 30 09:47:14.270719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=770000000,duration_sec=592,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:14.270991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:14.271371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:290 - starting polling. Elapsed:0.004 Sep 30 09:47:14.273399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:14.274892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 8588e984-7119-40f8-9e2a-800c04c4c6aa not present in bridge br-int Sep 30 09:47:14.275472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:47:14.275757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['8588e984-7119-40f8-9e2a-800c04c4c6aa'] Sep 30 09:47:14.276089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 8588e984-7119-40f8-9e2a-800c04c4c6aa is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:47:14.278700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:290 - port information retrieved. Elapsed:0.011 Sep 30 09:47:14.279035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:290 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:47:15.525164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:15Z,description='Default security group',id=2bf0431a-b94a-4f0f-9ed8-33dfea181287,is_default=True,name='default',project_id='aa4000b6511c476eb95622a6c86f4cf7',revision_number=1,rules=[SecurityGroupRule(25194dd1-1bc5-4826-934c-a2d96945fff3),SecurityGroupRule(4b278110-0a7b-4bc4-84cc-c0caea29760f),SecurityGroupRule(5e6f2274-0005-4f35-bc40-bdf39efe05c5),SecurityGroupRule(9ff85772-c04a-416f-a289-84279ff3a5e1)],shared=False,stateful=True,updated_at=2022-09-30T09:47:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:15.526242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (2bf0431a-b94a-4f0f-9ed8-33dfea181287), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.527028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:15Z,description=,direction='ingress',ethertype='IPv6',id=25194dd1-1bc5-4826-934c-a2d96945fff3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aa4000b6511c476eb95622a6c86f4cf7',protocol=,remote_address_group_id=,remote_group_id=2bf0431a-b94a-4f0f-9ed8-33dfea181287,remote_ip_prefix=,revision_number=0,security_group_id=2bf0431a-b94a-4f0f-9ed8-33dfea181287,updated_at=2022-09-30T09:47:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:15.527391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (25194dd1-1bc5-4826-934c-a2d96945fff3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.527759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Security group rule updated ['2bf0431a-b94a-4f0f-9ed8-33dfea181287'] Sep 30 09:47:15.528538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:15Z,description=,direction='ingress',ethertype='IPv4',id=4b278110-0a7b-4bc4-84cc-c0caea29760f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aa4000b6511c476eb95622a6c86f4cf7',protocol=,remote_address_group_id=,remote_group_id=2bf0431a-b94a-4f0f-9ed8-33dfea181287,remote_ip_prefix=,revision_number=0,security_group_id=2bf0431a-b94a-4f0f-9ed8-33dfea181287,updated_at=2022-09-30T09:47:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:15.529083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4b278110-0a7b-4bc4-84cc-c0caea29760f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.529408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Security group rule updated ['2bf0431a-b94a-4f0f-9ed8-33dfea181287'] Sep 30 09:47:15.530642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:15Z,description=,direction='egress',ethertype='IPv4',id=5e6f2274-0005-4f35-bc40-bdf39efe05c5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aa4000b6511c476eb95622a6c86f4cf7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2bf0431a-b94a-4f0f-9ed8-33dfea181287,updated_at=2022-09-30T09:47:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:15.531346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5e6f2274-0005-4f35-bc40-bdf39efe05c5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.536252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Security group rule updated ['2bf0431a-b94a-4f0f-9ed8-33dfea181287'] Sep 30 09:47:15.536252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:15Z,description=,direction='egress',ethertype='IPv6',id=9ff85772-c04a-416f-a289-84279ff3a5e1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aa4000b6511c476eb95622a6c86f4cf7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2bf0431a-b94a-4f0f-9ed8-33dfea181287,updated_at=2022-09-30T09:47:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:15.536252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (9ff85772-c04a-416f-a289-84279ff3a5e1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.536252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a4db7d90-c9cd-46bb-a706-af8540f98db8 admin admin] Security group rule updated ['2bf0431a-b94a-4f0f-9ed8-33dfea181287'] Sep 30 09:47:15.770649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:15Z,description='Default security group',id=92dcb01e-6f20-483d-9582-3c70a3b5a72d,is_default=True,name='default',project_id='e8f3f11ba4544c259c7fb8c6012443cb',revision_number=1,rules=[SecurityGroupRule(4ac8616d-7760-45ea-a0c8-345c98234981),SecurityGroupRule(6d17f956-be6e-478d-af9e-2b0fe6edabc1),SecurityGroupRule(b2a07c1b-7220-442d-8e97-dd07ad4612cd),SecurityGroupRule(f3732d23-8d5f-4239-a90a-342cb11f06cb)],shared=False,stateful=True,updated_at=2022-09-30T09:47:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:15.771048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (92dcb01e-6f20-483d-9582-3c70a3b5a72d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.771685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:15Z,description=,direction='ingress',ethertype='IPv4',id=4ac8616d-7760-45ea-a0c8-345c98234981,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e8f3f11ba4544c259c7fb8c6012443cb',protocol=,remote_address_group_id=,remote_group_id=92dcb01e-6f20-483d-9582-3c70a3b5a72d,remote_ip_prefix=,revision_number=0,security_group_id=92dcb01e-6f20-483d-9582-3c70a3b5a72d,updated_at=2022-09-30T09:47:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:15.772059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4ac8616d-7760-45ea-a0c8-345c98234981), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.772390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Security group rule updated ['92dcb01e-6f20-483d-9582-3c70a3b5a72d'] Sep 30 09:47:15.773079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:15Z,description=,direction='egress',ethertype='IPv4',id=6d17f956-be6e-478d-af9e-2b0fe6edabc1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e8f3f11ba4544c259c7fb8c6012443cb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=92dcb01e-6f20-483d-9582-3c70a3b5a72d,updated_at=2022-09-30T09:47:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:15.773595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (6d17f956-be6e-478d-af9e-2b0fe6edabc1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.774111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Security group rule updated ['92dcb01e-6f20-483d-9582-3c70a3b5a72d'] Sep 30 09:47:15.775657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:15Z,description=,direction='ingress',ethertype='IPv6',id=b2a07c1b-7220-442d-8e97-dd07ad4612cd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e8f3f11ba4544c259c7fb8c6012443cb',protocol=,remote_address_group_id=,remote_group_id=92dcb01e-6f20-483d-9582-3c70a3b5a72d,remote_ip_prefix=,revision_number=0,security_group_id=92dcb01e-6f20-483d-9582-3c70a3b5a72d,updated_at=2022-09-30T09:47:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:15.775875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b2a07c1b-7220-442d-8e97-dd07ad4612cd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.782098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Security group rule updated ['92dcb01e-6f20-483d-9582-3c70a3b5a72d'] Sep 30 09:47:15.782098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:15Z,description=,direction='egress',ethertype='IPv6',id=f3732d23-8d5f-4239-a90a-342cb11f06cb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e8f3f11ba4544c259c7fb8c6012443cb',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=92dcb01e-6f20-483d-9582-3c70a3b5a72d,updated_at=2022-09-30T09:47:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:15.782830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f3732d23-8d5f-4239-a90a-342cb11f06cb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.783347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-74bdb1e7-28ef-4cc0-833a-897d544af1b5 admin admin] Security group rule updated ['92dcb01e-6f20-483d-9582-3c70a3b5a72d'] Sep 30 09:47:15.825738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Resource SecurityGroup deleted: 2bf0431a-b94a-4f0f-9ed8-33dfea181287 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:15.827969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (2bf0431a-b94a-4f0f-9ed8-33dfea181287), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.827969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2bf0431a-b94a-4f0f-9ed8-33dfea181287',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:15.845224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2bf0431a-b94a-4f0f-9ed8-33dfea181287',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:15.845224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Resource SecurityGroupRule deleted: 25194dd1-1bc5-4826-934c-a2d96945fff3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:15.845224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (25194dd1-1bc5-4826-934c-a2d96945fff3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.845224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Security group rule updated ['2bf0431a-b94a-4f0f-9ed8-33dfea181287'] Sep 30 09:47:15.854159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Resource SecurityGroupRule deleted: 4b278110-0a7b-4bc4-84cc-c0caea29760f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:15.854876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4b278110-0a7b-4bc4-84cc-c0caea29760f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.855397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Security group rule updated ['2bf0431a-b94a-4f0f-9ed8-33dfea181287'] Sep 30 09:47:15.855864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Resource SecurityGroupRule deleted: 5e6f2274-0005-4f35-bc40-bdf39efe05c5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:15.856823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5e6f2274-0005-4f35-bc40-bdf39efe05c5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.857171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Security group rule updated ['2bf0431a-b94a-4f0f-9ed8-33dfea181287'] Sep 30 09:47:15.857555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Resource SecurityGroupRule deleted: 9ff85772-c04a-416f-a289-84279ff3a5e1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:15.859662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (9ff85772-c04a-416f-a289-84279ff3a5e1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:15.860002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4905164f-b656-4e1c-afc6-e0f8597a24d7 admin admin] Security group rule updated ['2bf0431a-b94a-4f0f-9ed8-33dfea181287'] Sep 30 09:47:16.269189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:291 started Sep 30 09:47:16.271675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=771000000,duration_sec=594,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:16.272249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:16.272604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:291 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:16.332150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Resource SecurityGroup deleted: 92dcb01e-6f20-483d-9582-3c70a3b5a72d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:16.332627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (92dcb01e-6f20-483d-9582-3c70a3b5a72d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.333154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('92dcb01e-6f20-483d-9582-3c70a3b5a72d',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:16.351896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('92dcb01e-6f20-483d-9582-3c70a3b5a72d',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:16.352670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Resource SecurityGroupRule deleted: 4ac8616d-7760-45ea-a0c8-345c98234981 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:16.353101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4ac8616d-7760-45ea-a0c8-345c98234981), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.353640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Security group rule updated ['92dcb01e-6f20-483d-9582-3c70a3b5a72d'] Sep 30 09:47:16.353993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Resource SecurityGroupRule deleted: 6d17f956-be6e-478d-af9e-2b0fe6edabc1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:16.354368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (6d17f956-be6e-478d-af9e-2b0fe6edabc1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.354724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Security group rule updated ['92dcb01e-6f20-483d-9582-3c70a3b5a72d'] Sep 30 09:47:16.355097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Resource SecurityGroupRule deleted: b2a07c1b-7220-442d-8e97-dd07ad4612cd {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:16.355445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b2a07c1b-7220-442d-8e97-dd07ad4612cd), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.360348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Security group rule updated ['92dcb01e-6f20-483d-9582-3c70a3b5a72d'] Sep 30 09:47:16.360348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Resource SecurityGroupRule deleted: f3732d23-8d5f-4239-a90a-342cb11f06cb {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:16.360348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f3732d23-8d5f-4239-a90a-342cb11f06cb), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.360348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e05ff2c2-8ca2-4fbd-b31f-c78a7c141e27 admin admin] Security group rule updated ['92dcb01e-6f20-483d-9582-3c70a3b5a72d'] Sep 30 09:47:16.690539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:16Z,description='Default security group',id=2e3d267e-ad60-4ecf-879e-0ef17eb2aff3,is_default=True,name='default',project_id='014647dd60d54c4791f979e379e6be42',revision_number=1,rules=[SecurityGroupRule(1c2be21c-d7d9-494b-bf94-23004dca2c56),SecurityGroupRule(299d5c80-1689-40c7-8895-5974b9064e70),SecurityGroupRule(7876eb7c-0e64-4da6-8ef1-dec1ae51e4e7),SecurityGroupRule(b1b8c99b-6edb-48cb-8be9-ec7292e800ad)],shared=False,stateful=True,updated_at=2022-09-30T09:47:16Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:16.691584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (2e3d267e-ad60-4ecf-879e-0ef17eb2aff3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.692722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:16Z,description=,direction='ingress',ethertype='IPv6',id=1c2be21c-d7d9-494b-bf94-23004dca2c56,normalized_cidr=None,port_range_max=,port_range_min=,project_id='014647dd60d54c4791f979e379e6be42',protocol=,remote_address_group_id=,remote_group_id=2e3d267e-ad60-4ecf-879e-0ef17eb2aff3,remote_ip_prefix=,revision_number=0,security_group_id=2e3d267e-ad60-4ecf-879e-0ef17eb2aff3,updated_at=2022-09-30T09:47:16Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:16.693085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (1c2be21c-d7d9-494b-bf94-23004dca2c56), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.693579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Security group rule updated ['2e3d267e-ad60-4ecf-879e-0ef17eb2aff3'] Sep 30 09:47:16.694443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:16Z,description=,direction='ingress',ethertype='IPv4',id=299d5c80-1689-40c7-8895-5974b9064e70,normalized_cidr=None,port_range_max=,port_range_min=,project_id='014647dd60d54c4791f979e379e6be42',protocol=,remote_address_group_id=,remote_group_id=2e3d267e-ad60-4ecf-879e-0ef17eb2aff3,remote_ip_prefix=,revision_number=0,security_group_id=2e3d267e-ad60-4ecf-879e-0ef17eb2aff3,updated_at=2022-09-30T09:47:16Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:16.694813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (299d5c80-1689-40c7-8895-5974b9064e70), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.695283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Security group rule updated ['2e3d267e-ad60-4ecf-879e-0ef17eb2aff3'] Sep 30 09:47:16.696097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:16Z,description=,direction='egress',ethertype='IPv4',id=7876eb7c-0e64-4da6-8ef1-dec1ae51e4e7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='014647dd60d54c4791f979e379e6be42',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2e3d267e-ad60-4ecf-879e-0ef17eb2aff3,updated_at=2022-09-30T09:47:16Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:16.696601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7876eb7c-0e64-4da6-8ef1-dec1ae51e4e7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.697066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Security group rule updated ['2e3d267e-ad60-4ecf-879e-0ef17eb2aff3'] Sep 30 09:47:16.697883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:16Z,description=,direction='egress',ethertype='IPv6',id=b1b8c99b-6edb-48cb-8be9-ec7292e800ad,normalized_cidr=None,port_range_max=,port_range_min=,project_id='014647dd60d54c4791f979e379e6be42',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2e3d267e-ad60-4ecf-879e-0ef17eb2aff3,updated_at=2022-09-30T09:47:16Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:16.698374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b1b8c99b-6edb-48cb-8be9-ec7292e800ad), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.698851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec457f34-5813-401a-a8c2-8b5780f391be admin admin] Security group rule updated ['2e3d267e-ad60-4ecf-879e-0ef17eb2aff3'] Sep 30 09:47:16.913384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Resource SecurityGroup deleted: 2e3d267e-ad60-4ecf-879e-0ef17eb2aff3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:16.915002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (2e3d267e-ad60-4ecf-879e-0ef17eb2aff3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.915719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2e3d267e-ad60-4ecf-879e-0ef17eb2aff3',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:16.928789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2e3d267e-ad60-4ecf-879e-0ef17eb2aff3',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:16.929248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Resource SecurityGroupRule deleted: 1c2be21c-d7d9-494b-bf94-23004dca2c56 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:16.929607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (1c2be21c-d7d9-494b-bf94-23004dca2c56), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.929936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Security group rule updated ['2e3d267e-ad60-4ecf-879e-0ef17eb2aff3'] Sep 30 09:47:16.932763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Resource SecurityGroupRule deleted: 299d5c80-1689-40c7-8895-5974b9064e70 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:16.932763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (299d5c80-1689-40c7-8895-5974b9064e70), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.932763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Security group rule updated ['2e3d267e-ad60-4ecf-879e-0ef17eb2aff3'] Sep 30 09:47:16.932763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Resource SecurityGroupRule deleted: 7876eb7c-0e64-4da6-8ef1-dec1ae51e4e7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:16.932763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7876eb7c-0e64-4da6-8ef1-dec1ae51e4e7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.933434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Security group rule updated ['2e3d267e-ad60-4ecf-879e-0ef17eb2aff3'] Sep 30 09:47:16.933434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Resource SecurityGroupRule deleted: b1b8c99b-6edb-48cb-8be9-ec7292e800ad {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:16.933434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b1b8c99b-6edb-48cb-8be9-ec7292e800ad), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:16.933434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-53a43893-7caa-4423-b718-d63eb56de3ab admin admin] Security group rule updated ['2e3d267e-ad60-4ecf-879e-0ef17eb2aff3'] Sep 30 09:47:17.363330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:17Z,description='Default security group',id=ca9c49db-063f-4a88-a378-333d296dc18d,is_default=True,name='default',project_id='ac90a94a900543c7b7017f2a053a9fda',revision_number=1,rules=[SecurityGroupRule(00d8c284-77d2-46e8-ab40-cd836ee71ef5),SecurityGroupRule(3624f337-d35e-4993-a4a4-de88bc2b3f27),SecurityGroupRule(a1178ba8-6230-40d7-875f-9ed8deb09523),SecurityGroupRule(b299a1ea-40f1-4d6e-adb3-56fdab0af582)],shared=False,stateful=True,updated_at=2022-09-30T09:47:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:17.363639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (ca9c49db-063f-4a88-a378-333d296dc18d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:17.364286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:17Z,description=,direction='ingress',ethertype='IPv4',id=00d8c284-77d2-46e8-ab40-cd836ee71ef5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ac90a94a900543c7b7017f2a053a9fda',protocol=,remote_address_group_id=,remote_group_id=ca9c49db-063f-4a88-a378-333d296dc18d,remote_ip_prefix=,revision_number=0,security_group_id=ca9c49db-063f-4a88-a378-333d296dc18d,updated_at=2022-09-30T09:47:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:17.364658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (00d8c284-77d2-46e8-ab40-cd836ee71ef5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:17.364993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Security group rule updated ['ca9c49db-063f-4a88-a378-333d296dc18d'] Sep 30 09:47:17.365689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:17Z,description=,direction='ingress',ethertype='IPv6',id=3624f337-d35e-4993-a4a4-de88bc2b3f27,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ac90a94a900543c7b7017f2a053a9fda',protocol=,remote_address_group_id=,remote_group_id=ca9c49db-063f-4a88-a378-333d296dc18d,remote_ip_prefix=,revision_number=0,security_group_id=ca9c49db-063f-4a88-a378-333d296dc18d,updated_at=2022-09-30T09:47:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:17.366039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (3624f337-d35e-4993-a4a4-de88bc2b3f27), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:17.366357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Security group rule updated ['ca9c49db-063f-4a88-a378-333d296dc18d'] Sep 30 09:47:17.367079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:17Z,description=,direction='egress',ethertype='IPv6',id=a1178ba8-6230-40d7-875f-9ed8deb09523,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ac90a94a900543c7b7017f2a053a9fda',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ca9c49db-063f-4a88-a378-333d296dc18d,updated_at=2022-09-30T09:47:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:17.367426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a1178ba8-6230-40d7-875f-9ed8deb09523), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:17.367804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Security group rule updated ['ca9c49db-063f-4a88-a378-333d296dc18d'] Sep 30 09:47:17.370689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:17Z,description=,direction='egress',ethertype='IPv4',id=b299a1ea-40f1-4d6e-adb3-56fdab0af582,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ac90a94a900543c7b7017f2a053a9fda',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ca9c49db-063f-4a88-a378-333d296dc18d,updated_at=2022-09-30T09:47:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:17.371060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b299a1ea-40f1-4d6e-adb3-56fdab0af582), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:17.371389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7787b9e0-6a42-4006-a944-a8a8b7843ab8 admin admin] Security group rule updated ['ca9c49db-063f-4a88-a378-333d296dc18d'] Sep 30 09:47:17.670044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Resource SecurityGroup deleted: ca9c49db-063f-4a88-a378-333d296dc18d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:17.670965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (ca9c49db-063f-4a88-a378-333d296dc18d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:17.671421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ca9c49db-063f-4a88-a378-333d296dc18d',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:17.688465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ca9c49db-063f-4a88-a378-333d296dc18d',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:17.688998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Resource SecurityGroupRule deleted: 00d8c284-77d2-46e8-ab40-cd836ee71ef5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:17.689649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (00d8c284-77d2-46e8-ab40-cd836ee71ef5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:17.689978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Security group rule updated ['ca9c49db-063f-4a88-a378-333d296dc18d'] Sep 30 09:47:17.690366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Resource SecurityGroupRule deleted: 3624f337-d35e-4993-a4a4-de88bc2b3f27 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:17.690903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (3624f337-d35e-4993-a4a4-de88bc2b3f27), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:17.691461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Security group rule updated ['ca9c49db-063f-4a88-a378-333d296dc18d'] Sep 30 09:47:17.692162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Resource SecurityGroupRule deleted: a1178ba8-6230-40d7-875f-9ed8deb09523 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:17.692673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a1178ba8-6230-40d7-875f-9ed8deb09523), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:17.693240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Security group rule updated ['ca9c49db-063f-4a88-a378-333d296dc18d'] Sep 30 09:47:17.693825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Resource SecurityGroupRule deleted: b299a1ea-40f1-4d6e-adb3-56fdab0af582 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:17.694502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b299a1ea-40f1-4d6e-adb3-56fdab0af582), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:17.695323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b45f051c-0d21-441d-a6dd-e3883e77721a admin admin] Security group rule updated ['ca9c49db-063f-4a88-a378-333d296dc18d'] Sep 30 09:47:18.269694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:292 started Sep 30 09:47:18.272590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=772000000,duration_sec=596,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:18.275083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:18.275617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:292 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:47:20.163060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:19Z,description='Default security group',id=96b93757-f50f-45e0-9679-6ba2bf7b48bc,is_default=True,name='default',project_id='82de32938a7340b391a698ddf94c8390',revision_number=1,rules=[SecurityGroupRule(1ae96e66-e84c-4971-9896-9a21039cbab8),SecurityGroupRule(306e0c43-6ec7-4052-bf7d-470c75e98e91),SecurityGroupRule(50f0800f-a749-4452-b161-6579188a49d6),SecurityGroupRule(b3900777-6286-42fa-a3be-52afa91e7e4f)],shared=False,stateful=True,updated_at=2022-09-30T09:47:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:20.163712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (96b93757-f50f-45e0-9679-6ba2bf7b48bc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:20.164136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:19Z,description=,direction='ingress',ethertype='IPv6',id=1ae96e66-e84c-4971-9896-9a21039cbab8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='82de32938a7340b391a698ddf94c8390',protocol=,remote_address_group_id=,remote_group_id=96b93757-f50f-45e0-9679-6ba2bf7b48bc,remote_ip_prefix=,revision_number=0,security_group_id=96b93757-f50f-45e0-9679-6ba2bf7b48bc,updated_at=2022-09-30T09:47:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:20.164509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (1ae96e66-e84c-4971-9896-9a21039cbab8), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:20.164849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Security group rule updated ['96b93757-f50f-45e0-9679-6ba2bf7b48bc'] Sep 30 09:47:20.165546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:19Z,description=,direction='ingress',ethertype='IPv4',id=306e0c43-6ec7-4052-bf7d-470c75e98e91,normalized_cidr=None,port_range_max=,port_range_min=,project_id='82de32938a7340b391a698ddf94c8390',protocol=,remote_address_group_id=,remote_group_id=96b93757-f50f-45e0-9679-6ba2bf7b48bc,remote_ip_prefix=,revision_number=0,security_group_id=96b93757-f50f-45e0-9679-6ba2bf7b48bc,updated_at=2022-09-30T09:47:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:20.165907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (306e0c43-6ec7-4052-bf7d-470c75e98e91), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:20.166238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Security group rule updated ['96b93757-f50f-45e0-9679-6ba2bf7b48bc'] Sep 30 09:47:20.167040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:19Z,description=,direction='egress',ethertype='IPv4',id=50f0800f-a749-4452-b161-6579188a49d6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='82de32938a7340b391a698ddf94c8390',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=96b93757-f50f-45e0-9679-6ba2bf7b48bc,updated_at=2022-09-30T09:47:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:20.167279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (50f0800f-a749-4452-b161-6579188a49d6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:20.167746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Security group rule updated ['96b93757-f50f-45e0-9679-6ba2bf7b48bc'] Sep 30 09:47:20.168534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:19Z,description=,direction='egress',ethertype='IPv6',id=b3900777-6286-42fa-a3be-52afa91e7e4f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='82de32938a7340b391a698ddf94c8390',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=96b93757-f50f-45e0-9679-6ba2bf7b48bc,updated_at=2022-09-30T09:47:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:20.168870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b3900777-6286-42fa-a3be-52afa91e7e4f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:20.169241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e84627ae-a7b3-4588-abca-19d8c8a3ee28 admin admin] Security group rule updated ['96b93757-f50f-45e0-9679-6ba2bf7b48bc'] Sep 30 09:47:20.270983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:293 started Sep 30 09:47:20.273529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=773000000,duration_sec=598,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:20.274180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:20.274640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:293 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:20.400016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-83f8a82d-c353-4ea4-8047-2692a05c811c admin admin] Resource Port deleted: 0edf3085-2343-477c-aeff-24dca5130af3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:20.408067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-83f8a82d-c353-4ea4-8047-2692a05c811c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (0edf3085-2343-477c-aeff-24dca5130af3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:20.413532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Resource SecurityGroup deleted: 96b93757-f50f-45e0-9679-6ba2bf7b48bc {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:20.417020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (96b93757-f50f-45e0-9679-6ba2bf7b48bc), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:20.417020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('96b93757-f50f-45e0-9679-6ba2bf7b48bc',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:20.431625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('96b93757-f50f-45e0-9679-6ba2bf7b48bc',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:20.432283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Resource SecurityGroupRule deleted: 1ae96e66-e84c-4971-9896-9a21039cbab8 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:20.432812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (1ae96e66-e84c-4971-9896-9a21039cbab8), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:20.433314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Security group rule updated ['96b93757-f50f-45e0-9679-6ba2bf7b48bc'] Sep 30 09:47:20.433711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Resource SecurityGroupRule deleted: 306e0c43-6ec7-4052-bf7d-470c75e98e91 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:20.434061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (306e0c43-6ec7-4052-bf7d-470c75e98e91), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:20.434551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Security group rule updated ['96b93757-f50f-45e0-9679-6ba2bf7b48bc'] Sep 30 09:47:20.435011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Resource SecurityGroupRule deleted: 50f0800f-a749-4452-b161-6579188a49d6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:20.435322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (50f0800f-a749-4452-b161-6579188a49d6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:20.435668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Security group rule updated ['96b93757-f50f-45e0-9679-6ba2bf7b48bc'] Sep 30 09:47:20.436035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Resource SecurityGroupRule deleted: b3900777-6286-42fa-a3be-52afa91e7e4f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:20.436379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b3900777-6286-42fa-a3be-52afa91e7e4f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:20.436699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0a6f0a35-0222-4191-9624-20060502c2d9 admin admin] Security group rule updated ['96b93757-f50f-45e0-9679-6ba2bf7b48bc'] Sep 30 09:47:21.559952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:21Z,description='Default security group',id=1b343e53-604c-4a96-856a-6d5fe229f73a,is_default=True,name='default',project_id='a78c4b96aca44d8aa8cf6be70b245120',revision_number=1,rules=[SecurityGroupRule(2b3c55b9-0651-429a-9cd9-7dd219808c18),SecurityGroupRule(94ab6556-f3a6-458a-a9be-c7b70bed914a),SecurityGroupRule(9b6ce3c1-d6ec-45f4-8a22-7979bc360b1f),SecurityGroupRule(b8ff9cde-8ab1-47e2-9cd1-7a145a5c1142)],shared=False,stateful=True,updated_at=2022-09-30T09:47:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:21.561134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (1b343e53-604c-4a96-856a-6d5fe229f73a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:21.561527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:21Z,description=,direction='ingress',ethertype='IPv6',id=2b3c55b9-0651-429a-9cd9-7dd219808c18,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a78c4b96aca44d8aa8cf6be70b245120',protocol=,remote_address_group_id=,remote_group_id=1b343e53-604c-4a96-856a-6d5fe229f73a,remote_ip_prefix=,revision_number=0,security_group_id=1b343e53-604c-4a96-856a-6d5fe229f73a,updated_at=2022-09-30T09:47:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:21.561891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2b3c55b9-0651-429a-9cd9-7dd219808c18), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:21.562340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Security group rule updated ['1b343e53-604c-4a96-856a-6d5fe229f73a'] Sep 30 09:47:21.563049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:21Z,description=,direction='egress',ethertype='IPv6',id=94ab6556-f3a6-458a-a9be-c7b70bed914a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a78c4b96aca44d8aa8cf6be70b245120',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1b343e53-604c-4a96-856a-6d5fe229f73a,updated_at=2022-09-30T09:47:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:21.563403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (94ab6556-f3a6-458a-a9be-c7b70bed914a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:21.563728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Security group rule updated ['1b343e53-604c-4a96-856a-6d5fe229f73a'] Sep 30 09:47:21.564384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:21Z,description=,direction='ingress',ethertype='IPv4',id=9b6ce3c1-d6ec-45f4-8a22-7979bc360b1f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a78c4b96aca44d8aa8cf6be70b245120',protocol=,remote_address_group_id=,remote_group_id=1b343e53-604c-4a96-856a-6d5fe229f73a,remote_ip_prefix=,revision_number=0,security_group_id=1b343e53-604c-4a96-856a-6d5fe229f73a,updated_at=2022-09-30T09:47:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:21.564736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (9b6ce3c1-d6ec-45f4-8a22-7979bc360b1f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:21.565059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Security group rule updated ['1b343e53-604c-4a96-856a-6d5fe229f73a'] Sep 30 09:47:21.565739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:21Z,description=,direction='egress',ethertype='IPv4',id=b8ff9cde-8ab1-47e2-9cd1-7a145a5c1142,normalized_cidr=None,port_range_max=,port_range_min=,project_id='a78c4b96aca44d8aa8cf6be70b245120',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1b343e53-604c-4a96-856a-6d5fe229f73a,updated_at=2022-09-30T09:47:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:21.566092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b8ff9cde-8ab1-47e2-9cd1-7a145a5c1142), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:21.570857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d9bdcf63-b3af-42be-810f-20b542ca4070 admin admin] Security group rule updated ['1b343e53-604c-4a96-856a-6d5fe229f73a'] Sep 30 09:47:21.751553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f5cb5162-8d60-4a62-a5a5-62b5b6f18bea","delete","qr-0edf3085-23",12,["map",[["attached-mac","fa:16:3e:fb:32:4a"],["iface-id","0edf3085-2343-477c-aeff-24dca5130af3"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:47:21.867008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Resource SecurityGroup deleted: 1b343e53-604c-4a96-856a-6d5fe229f73a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:21.868218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (1b343e53-604c-4a96-856a-6d5fe229f73a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:21.868793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1b343e53-604c-4a96-856a-6d5fe229f73a',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:21.896081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1b343e53-604c-4a96-856a-6d5fe229f73a',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:21.896627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Resource SecurityGroupRule deleted: 2b3c55b9-0651-429a-9cd9-7dd219808c18 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:21.897212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2b3c55b9-0651-429a-9cd9-7dd219808c18), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:21.897691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Security group rule updated ['1b343e53-604c-4a96-856a-6d5fe229f73a'] Sep 30 09:47:21.898205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Resource SecurityGroupRule deleted: 94ab6556-f3a6-458a-a9be-c7b70bed914a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:21.899110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (94ab6556-f3a6-458a-a9be-c7b70bed914a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:21.899679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Security group rule updated ['1b343e53-604c-4a96-856a-6d5fe229f73a'] Sep 30 09:47:21.900253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Resource SecurityGroupRule deleted: 9b6ce3c1-d6ec-45f4-8a22-7979bc360b1f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:21.900813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (9b6ce3c1-d6ec-45f4-8a22-7979bc360b1f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:21.901481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Security group rule updated ['1b343e53-604c-4a96-856a-6d5fe229f73a'] Sep 30 09:47:21.902052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Resource SecurityGroupRule deleted: b8ff9cde-8ab1-47e2-9cd1-7a145a5c1142 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:21.903436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b8ff9cde-8ab1-47e2-9cd1-7a145a5c1142), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:21.903985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5da2d3f9-f5d1-4ac9-8b18-bb364c58dd4f admin admin] Security group rule updated ['1b343e53-604c-4a96-856a-6d5fe229f73a'] Sep 30 09:47:22.204395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["553964b7-60f5-4345-92f6-540740611878","delete","qg-52ee2a7a-6d",13,["map",[["attached-mac","fa:16:3e:73:ee:49"],["iface-id","52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:47:22.271997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:294 started Sep 30 09:47:22.451853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7332e2f8-3ed1-41b5-863e-536fcdf43303 admin admin] Resource Port deleted: 52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:22.452257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7332e2f8-3ed1-41b5-863e-536fcdf43303 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:22.510987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:22Z,description='Default security group',id=a1f64f36-7da9-48ab-aae2-f325ae2d631e,is_default=True,name='default',project_id='4f3bb3aa4bba4d61861f179a59de5f13',revision_number=1,rules=[SecurityGroupRule(0e187156-2832-4e65-98cb-fd2914183d47),SecurityGroupRule(5366ff74-a178-4bf3-b614-6150e6abad96),SecurityGroupRule(7a52f0ad-dffe-4d6c-be5c-cb7b7e6a7fa7),SecurityGroupRule(c99dc434-5842-4ec6-92bd-efdd8b3d5e27)],shared=False,stateful=True,updated_at=2022-09-30T09:47:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:22.511494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (a1f64f36-7da9-48ab-aae2-f325ae2d631e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:22.512379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:22Z,description=,direction='egress',ethertype='IPv4',id=0e187156-2832-4e65-98cb-fd2914183d47,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4f3bb3aa4bba4d61861f179a59de5f13',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a1f64f36-7da9-48ab-aae2-f325ae2d631e,updated_at=2022-09-30T09:47:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:22.512742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (0e187156-2832-4e65-98cb-fd2914183d47), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:22.513074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Security group rule updated ['a1f64f36-7da9-48ab-aae2-f325ae2d631e'] Sep 30 09:47:22.514688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:22Z,description=,direction='egress',ethertype='IPv6',id=5366ff74-a178-4bf3-b614-6150e6abad96,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4f3bb3aa4bba4d61861f179a59de5f13',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a1f64f36-7da9-48ab-aae2-f325ae2d631e,updated_at=2022-09-30T09:47:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:22.514793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5366ff74-a178-4bf3-b614-6150e6abad96), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:22.515066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Security group rule updated ['a1f64f36-7da9-48ab-aae2-f325ae2d631e'] Sep 30 09:47:22.515893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:22Z,description=,direction='ingress',ethertype='IPv4',id=7a52f0ad-dffe-4d6c-be5c-cb7b7e6a7fa7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4f3bb3aa4bba4d61861f179a59de5f13',protocol=,remote_address_group_id=,remote_group_id=a1f64f36-7da9-48ab-aae2-f325ae2d631e,remote_ip_prefix=,revision_number=0,security_group_id=a1f64f36-7da9-48ab-aae2-f325ae2d631e,updated_at=2022-09-30T09:47:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:22.516046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7a52f0ad-dffe-4d6c-be5c-cb7b7e6a7fa7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:22.519182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Security group rule updated ['a1f64f36-7da9-48ab-aae2-f325ae2d631e'] Sep 30 09:47:22.520274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:22Z,description=,direction='ingress',ethertype='IPv6',id=c99dc434-5842-4ec6-92bd-efdd8b3d5e27,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4f3bb3aa4bba4d61861f179a59de5f13',protocol=,remote_address_group_id=,remote_group_id=a1f64f36-7da9-48ab-aae2-f325ae2d631e,remote_ip_prefix=,revision_number=0,security_group_id=a1f64f36-7da9-48ab-aae2-f325ae2d631e,updated_at=2022-09-30T09:47:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:22.520623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c99dc434-5842-4ec6-92bd-efdd8b3d5e27), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:22.521532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d91a9549-2ea2-4c96-963d-476bff9ca839 admin admin] Security group rule updated ['a1f64f36-7da9-48ab-aae2-f325ae2d631e'] Sep 30 09:47:22.535783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=997000000,duration_sec=600,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:22.536382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:22.536831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:294 - starting polling. Elapsed:0.265 Sep 30 09:47:22.538700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:22.557059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c03da,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 12}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:22.559934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c03dc,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 13}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:22.560993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:294 - port information retrieved. Elapsed:0.289 Sep 30 09:47:22.561672 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', 'c147afeb-a580-4f58-9be3-0d2e0482431c', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': set(), 'removed': {'0edf3085-2343-477c-aeff-24dca5130af3', '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:47:22.561764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:294 - agent port security group processed in 0.000 Sep 30 09:47:22.563634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:47:22.563937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'0edf3085-2343-477c-aeff-24dca5130af3', '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac'} Sep 30 09:47:22.564605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 8 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:47:22.647831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be5b472-3546-4993-9cf7-e4cb08d1b2cc]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:47:22.649486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'0edf3085-2343-477c-aeff-24dca5130af3', '52ee2a7a-6da2-43e2-a9b2-9ed4261b02ac'} removed Sep 30 09:47:22.703297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:47:22.703827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:294 - treat_devices_removed completed in 0.140 Sep 30 09:47:22.704155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:294 - ports processed. Elapsed:0.432 Sep 30 09:47:22.704654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:294 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.433 Sep 30 09:47:22.958368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:22Z,description='Default security group',id=0ecfc5eb-0705-405a-bf59-e09d65bbf3ab,is_default=True,name='default',project_id='d951df5495244097a4026510af3b616f',revision_number=1,rules=[SecurityGroupRule(201aa167-23a0-48d9-9954-8eca9d845679),SecurityGroupRule(2160233d-5f25-4795-b8e0-313955b02a51),SecurityGroupRule(bf22327a-d6db-4dfc-b9a8-90448119b40b),SecurityGroupRule(f89da9a6-59a1-492c-8094-492b94fe5241)],shared=False,stateful=True,updated_at=2022-09-30T09:47:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:22.958905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (0ecfc5eb-0705-405a-bf59-e09d65bbf3ab), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:22.959633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:22Z,description=,direction='ingress',ethertype='IPv4',id=201aa167-23a0-48d9-9954-8eca9d845679,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d951df5495244097a4026510af3b616f',protocol=,remote_address_group_id=,remote_group_id=0ecfc5eb-0705-405a-bf59-e09d65bbf3ab,remote_ip_prefix=,revision_number=0,security_group_id=0ecfc5eb-0705-405a-bf59-e09d65bbf3ab,updated_at=2022-09-30T09:47:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:22.960087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (201aa167-23a0-48d9-9954-8eca9d845679), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:22.960517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Security group rule updated ['0ecfc5eb-0705-405a-bf59-e09d65bbf3ab'] Sep 30 09:47:22.961301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:22Z,description=,direction='ingress',ethertype='IPv6',id=2160233d-5f25-4795-b8e0-313955b02a51,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d951df5495244097a4026510af3b616f',protocol=,remote_address_group_id=,remote_group_id=0ecfc5eb-0705-405a-bf59-e09d65bbf3ab,remote_ip_prefix=,revision_number=0,security_group_id=0ecfc5eb-0705-405a-bf59-e09d65bbf3ab,updated_at=2022-09-30T09:47:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:22.961753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2160233d-5f25-4795-b8e0-313955b02a51), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:22.962173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Security group rule updated ['0ecfc5eb-0705-405a-bf59-e09d65bbf3ab'] Sep 30 09:47:22.963257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:22Z,description=,direction='egress',ethertype='IPv6',id=bf22327a-d6db-4dfc-b9a8-90448119b40b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d951df5495244097a4026510af3b616f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0ecfc5eb-0705-405a-bf59-e09d65bbf3ab,updated_at=2022-09-30T09:47:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:22.963706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (bf22327a-d6db-4dfc-b9a8-90448119b40b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:22.964829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Security group rule updated ['0ecfc5eb-0705-405a-bf59-e09d65bbf3ab'] Sep 30 09:47:22.965627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:22Z,description=,direction='egress',ethertype='IPv4',id=f89da9a6-59a1-492c-8094-492b94fe5241,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d951df5495244097a4026510af3b616f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0ecfc5eb-0705-405a-bf59-e09d65bbf3ab,updated_at=2022-09-30T09:47:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:22.966164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f89da9a6-59a1-492c-8094-492b94fe5241), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:22.967686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b206f8bc-7838-4059-bef8-f650a1984988 admin admin] Security group rule updated ['0ecfc5eb-0705-405a-bf59-e09d65bbf3ab'] Sep 30 09:47:22.995210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Resource SecurityGroup deleted: a1f64f36-7da9-48ab-aae2-f325ae2d631e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:22.995210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (a1f64f36-7da9-48ab-aae2-f325ae2d631e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:22.995210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a1f64f36-7da9-48ab-aae2-f325ae2d631e',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:23.016707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a1f64f36-7da9-48ab-aae2-f325ae2d631e',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:23.017265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Resource SecurityGroupRule deleted: 0e187156-2832-4e65-98cb-fd2914183d47 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:23.017789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (0e187156-2832-4e65-98cb-fd2914183d47), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.018337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Security group rule updated ['a1f64f36-7da9-48ab-aae2-f325ae2d631e'] Sep 30 09:47:23.018657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Resource SecurityGroupRule deleted: 5366ff74-a178-4bf3-b614-6150e6abad96 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:23.019073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5366ff74-a178-4bf3-b614-6150e6abad96), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.019389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Security group rule updated ['a1f64f36-7da9-48ab-aae2-f325ae2d631e'] Sep 30 09:47:23.019811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Resource SecurityGroupRule deleted: 7a52f0ad-dffe-4d6c-be5c-cb7b7e6a7fa7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:23.020312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7a52f0ad-dffe-4d6c-be5c-cb7b7e6a7fa7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.020633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Security group rule updated ['a1f64f36-7da9-48ab-aae2-f325ae2d631e'] Sep 30 09:47:23.020996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Resource SecurityGroupRule deleted: c99dc434-5842-4ec6-92bd-efdd8b3d5e27 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:23.021331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c99dc434-5842-4ec6-92bd-efdd8b3d5e27), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.021685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-62a6a1a9-0159-4e22-8b7d-ed8243d57919 admin admin] Security group rule updated ['a1f64f36-7da9-48ab-aae2-f325ae2d631e'] Sep 30 09:47:23.362779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Resource SecurityGroup deleted: 0ecfc5eb-0705-405a-bf59-e09d65bbf3ab {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:23.363198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (0ecfc5eb-0705-405a-bf59-e09d65bbf3ab), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.363660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0ecfc5eb-0705-405a-bf59-e09d65bbf3ab',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:23.376230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0ecfc5eb-0705-405a-bf59-e09d65bbf3ab',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:23.376700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Resource SecurityGroupRule deleted: 201aa167-23a0-48d9-9954-8eca9d845679 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:23.377086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (201aa167-23a0-48d9-9954-8eca9d845679), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.377599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Security group rule updated ['0ecfc5eb-0705-405a-bf59-e09d65bbf3ab'] Sep 30 09:47:23.377973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Resource SecurityGroupRule deleted: 2160233d-5f25-4795-b8e0-313955b02a51 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:23.378321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2160233d-5f25-4795-b8e0-313955b02a51), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.378668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Security group rule updated ['0ecfc5eb-0705-405a-bf59-e09d65bbf3ab'] Sep 30 09:47:23.379038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Resource SecurityGroupRule deleted: bf22327a-d6db-4dfc-b9a8-90448119b40b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:23.379466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (bf22327a-d6db-4dfc-b9a8-90448119b40b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.380767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Security group rule updated ['0ecfc5eb-0705-405a-bf59-e09d65bbf3ab'] Sep 30 09:47:23.381159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Resource SecurityGroupRule deleted: f89da9a6-59a1-492c-8094-492b94fe5241 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:23.381500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f89da9a6-59a1-492c-8094-492b94fe5241), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.381995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-828de87f-2d54-4a09-a0e2-d6da82f320ef admin admin] Security group rule updated ['0ecfc5eb-0705-405a-bf59-e09d65bbf3ab'] Sep 30 09:47:23.427541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-36fc528b-1b76-451b-a7a5-43dcaf2337f5 admin admin] Resource Subnet deleted: 60a86eb6-daf2-49f6-a6fa-6f3fdc65436e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:23.430931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-36fc528b-1b76-451b-a7a5-43dcaf2337f5 admin admin] Publish callbacks [] for Subnet (60a86eb6-daf2-49f6-a6fa-6f3fdc65436e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.586574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["77737eee-9f13-4970-b0a0-9f3fe7f02c00","delete","tapc147afeb-a5",7,["map",[["attached-mac","fa:16:3e:ca:5f:df"],["iface-id","c147afeb-a580-4f58-9be3-0d2e0482431c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:47:23.975980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:23Z,description='Default security group',id=6c990c2b-ce67-4816-94c4-68678a90b7f1,is_default=True,name='default',project_id='fcd06564ba0843d6b521120bebe94b95',revision_number=1,rules=[SecurityGroupRule(0d880f02-759c-41fc-bc1a-59a9867f2477),SecurityGroupRule(b3b8c596-2cea-4e5a-9674-50f8389beda6),SecurityGroupRule(b7f12de9-b7ae-4f25-9119-b972d47cbd7f),SecurityGroupRule(bd03f51d-ace1-4ce9-8fdb-30854b68c3b1)],shared=False,stateful=True,updated_at=2022-09-30T09:47:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:23.976361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (6c990c2b-ce67-4816-94c4-68678a90b7f1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.976985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:23Z,description=,direction='egress',ethertype='IPv6',id=0d880f02-759c-41fc-bc1a-59a9867f2477,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fcd06564ba0843d6b521120bebe94b95',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6c990c2b-ce67-4816-94c4-68678a90b7f1,updated_at=2022-09-30T09:47:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:23.977344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (0d880f02-759c-41fc-bc1a-59a9867f2477), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.977682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Security group rule updated ['6c990c2b-ce67-4816-94c4-68678a90b7f1'] Sep 30 09:47:23.978351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:23Z,description=,direction='ingress',ethertype='IPv4',id=b3b8c596-2cea-4e5a-9674-50f8389beda6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fcd06564ba0843d6b521120bebe94b95',protocol=,remote_address_group_id=,remote_group_id=6c990c2b-ce67-4816-94c4-68678a90b7f1,remote_ip_prefix=,revision_number=0,security_group_id=6c990c2b-ce67-4816-94c4-68678a90b7f1,updated_at=2022-09-30T09:47:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:23.978969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b3b8c596-2cea-4e5a-9674-50f8389beda6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.979490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Security group rule updated ['6c990c2b-ce67-4816-94c4-68678a90b7f1'] Sep 30 09:47:23.980299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:23Z,description=,direction='ingress',ethertype='IPv6',id=b7f12de9-b7ae-4f25-9119-b972d47cbd7f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fcd06564ba0843d6b521120bebe94b95',protocol=,remote_address_group_id=,remote_group_id=6c990c2b-ce67-4816-94c4-68678a90b7f1,remote_ip_prefix=,revision_number=0,security_group_id=6c990c2b-ce67-4816-94c4-68678a90b7f1,updated_at=2022-09-30T09:47:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:23.980815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b7f12de9-b7ae-4f25-9119-b972d47cbd7f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.981300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Security group rule updated ['6c990c2b-ce67-4816-94c4-68678a90b7f1'] Sep 30 09:47:23.981966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:23Z,description=,direction='egress',ethertype='IPv4',id=bd03f51d-ace1-4ce9-8fdb-30854b68c3b1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fcd06564ba0843d6b521120bebe94b95',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6c990c2b-ce67-4816-94c4-68678a90b7f1,updated_at=2022-09-30T09:47:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:23.982387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (bd03f51d-ace1-4ce9-8fdb-30854b68c3b1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:23.982731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0da3a6f0-5fa8-4e1b-8714-e1a10a3e77e3 admin admin] Security group rule updated ['6c990c2b-ce67-4816-94c4-68678a90b7f1'] Sep 30 09:47:24.054898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:23Z,description='Default security group',id=70be71a1-88a4-4353-bd88-3cd65a51fbf8,is_default=True,name='default',project_id='59079381c1824e989b2ee73803e4f0f7',revision_number=1,rules=[SecurityGroupRule(537f4fc5-9c7a-4552-bf36-007a9ae56bde),SecurityGroupRule(71223b56-abf0-4c0b-adc0-5e35e24ce4fc),SecurityGroupRule(93419c41-459e-426d-8aa6-7b44ca5263ed),SecurityGroupRule(b4f8279c-ee20-4ec0-a9e8-80e77c734dca)],shared=False,stateful=True,updated_at=2022-09-30T09:47:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:24.055283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (70be71a1-88a4-4353-bd88-3cd65a51fbf8), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.055917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:23Z,description=,direction='egress',ethertype='IPv6',id=537f4fc5-9c7a-4552-bf36-007a9ae56bde,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59079381c1824e989b2ee73803e4f0f7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=70be71a1-88a4-4353-bd88-3cd65a51fbf8,updated_at=2022-09-30T09:47:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:24.056275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (537f4fc5-9c7a-4552-bf36-007a9ae56bde), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.057037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Security group rule updated ['70be71a1-88a4-4353-bd88-3cd65a51fbf8'] Sep 30 09:47:24.057877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:23Z,description=,direction='egress',ethertype='IPv4',id=71223b56-abf0-4c0b-adc0-5e35e24ce4fc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59079381c1824e989b2ee73803e4f0f7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=70be71a1-88a4-4353-bd88-3cd65a51fbf8,updated_at=2022-09-30T09:47:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:24.058641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (71223b56-abf0-4c0b-adc0-5e35e24ce4fc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.059167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Security group rule updated ['70be71a1-88a4-4353-bd88-3cd65a51fbf8'] Sep 30 09:47:24.061470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:23Z,description=,direction='ingress',ethertype='IPv6',id=93419c41-459e-426d-8aa6-7b44ca5263ed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59079381c1824e989b2ee73803e4f0f7',protocol=,remote_address_group_id=,remote_group_id=70be71a1-88a4-4353-bd88-3cd65a51fbf8,remote_ip_prefix=,revision_number=0,security_group_id=70be71a1-88a4-4353-bd88-3cd65a51fbf8,updated_at=2022-09-30T09:47:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:24.062568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (93419c41-459e-426d-8aa6-7b44ca5263ed), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.063263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Security group rule updated ['70be71a1-88a4-4353-bd88-3cd65a51fbf8'] Sep 30 09:47:24.064193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:23Z,description=,direction='ingress',ethertype='IPv4',id=b4f8279c-ee20-4ec0-a9e8-80e77c734dca,normalized_cidr=None,port_range_max=,port_range_min=,project_id='59079381c1824e989b2ee73803e4f0f7',protocol=,remote_address_group_id=,remote_group_id=70be71a1-88a4-4353-bd88-3cd65a51fbf8,remote_ip_prefix=,revision_number=0,security_group_id=70be71a1-88a4-4353-bd88-3cd65a51fbf8,updated_at=2022-09-30T09:47:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:24.065218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b4f8279c-ee20-4ec0-a9e8-80e77c734dca), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.065785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-04ab0a11-cbb5-46b8-a3c9-4702e37d2a48 admin admin] Security group rule updated ['70be71a1-88a4-4353-bd88-3cd65a51fbf8'] Sep 30 09:47:24.141609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f5fc4d50-fe77-4913-a4e4-a155f832e581 admin admin] Resource Port deleted: c147afeb-a580-4f58-9be3-0d2e0482431c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:24.142082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f5fc4d50-fe77-4913-a4e4-a155f832e581 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (c147afeb-a580-4f58-9be3-0d2e0482431c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.162069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f73edb7b-cc72-4a0b-9a94-efc459f48190 None None] Resource Port deleted: c147afeb-a580-4f58-9be3-0d2e0482431c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:24.164477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f73edb7b-cc72-4a0b-9a94-efc459f48190 None None] Skipped duplicate delete event for c147afeb-a580-4f58-9be3-0d2e0482431c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 30 09:47:24.273119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:295 started Sep 30 09:47:24.278018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03de,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=776000000,duration_sec=602,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:24.280085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:24.281667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:295 - starting polling. Elapsed:0.008 Sep 30 09:47:24.283382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.286883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Resource SecurityGroup deleted: 6c990c2b-ce67-4816-94c4-68678a90b7f1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:24.287247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (6c990c2b-ce67-4816-94c4-68678a90b7f1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.287768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6c990c2b-ce67-4816-94c4-68678a90b7f1',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:24.291669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c03e0,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 7}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:24.292161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:295 - port information retrieved. Elapsed:0.019 Sep 30 09:47:24.292639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': set(), 'removed': {'c147afeb-a580-4f58-9be3-0d2e0482431c'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:47:24.293307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:295 - agent port security group processed in 0.000 Sep 30 09:47:24.296217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:47:24.296986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'c147afeb-a580-4f58-9be3-0d2e0482431c'} Sep 30 09:47:24.297098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:47:24.314714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6c990c2b-ce67-4816-94c4-68678a90b7f1',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:24.315428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Resource SecurityGroupRule deleted: 0d880f02-759c-41fc-bc1a-59a9867f2477 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:24.316455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (0d880f02-759c-41fc-bc1a-59a9867f2477), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.316998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Security group rule updated ['6c990c2b-ce67-4816-94c4-68678a90b7f1'] Sep 30 09:47:24.317557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Resource SecurityGroupRule deleted: b3b8c596-2cea-4e5a-9674-50f8389beda6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:24.319772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b3b8c596-2cea-4e5a-9674-50f8389beda6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.320191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Security group rule updated ['6c990c2b-ce67-4816-94c4-68678a90b7f1'] Sep 30 09:47:24.321047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Resource SecurityGroupRule deleted: b7f12de9-b7ae-4f25-9119-b972d47cbd7f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:24.321555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b7f12de9-b7ae-4f25-9119-b972d47cbd7f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.322030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Security group rule updated ['6c990c2b-ce67-4816-94c4-68678a90b7f1'] Sep 30 09:47:24.322556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Resource SecurityGroupRule deleted: bd03f51d-ace1-4ce9-8fdb-30854b68c3b1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:24.323019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (bd03f51d-ace1-4ce9-8fdb-30854b68c3b1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.323505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a23bf817-daaf-4b68-96e7-9383cc3b2c06 admin admin] Security group rule updated ['6c990c2b-ce67-4816-94c4-68678a90b7f1'] Sep 30 09:47:24.336647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fa3066-fc0f-4b79-939a-0dee673c463b]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:47:24.337255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'c147afeb-a580-4f58-9be3-0d2e0482431c'} removed Sep 30 09:47:24.381127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:47:24.383295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Reclaiming vlan = 6 from net-id = 5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3, seg-id = 366 Sep 30 09:47:24.387762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xc9105ef0,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16864421859504038737,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4102}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:24.392694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xf1c03e2,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4462}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:24.394500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:295 - treat_devices_removed completed in 0.096 Sep 30 09:47:24.394500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:295 - ports processed. Elapsed:0.121 Sep 30 09:47:24.394500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:295 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.121 Sep 30 09:47:24.771858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f5fc4d50-fe77-4913-a4e4-a155f832e581 admin admin] Resource Network deleted: 5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:24.777910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f5fc4d50-fe77-4913-a4e4-a155f832e581 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (5ccfff4c-afb9-44a9-8e8c-e57c26fbfae3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.793959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Resource SecurityGroup deleted: 70be71a1-88a4-4353-bd88-3cd65a51fbf8 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:24.794409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (70be71a1-88a4-4353-bd88-3cd65a51fbf8), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.795677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('70be71a1-88a4-4353-bd88-3cd65a51fbf8',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:24.811542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('70be71a1-88a4-4353-bd88-3cd65a51fbf8',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:24.812285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Resource SecurityGroupRule deleted: 537f4fc5-9c7a-4552-bf36-007a9ae56bde {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:24.812661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (537f4fc5-9c7a-4552-bf36-007a9ae56bde), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.812996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Security group rule updated ['70be71a1-88a4-4353-bd88-3cd65a51fbf8'] Sep 30 09:47:24.813532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Resource SecurityGroupRule deleted: 71223b56-abf0-4c0b-adc0-5e35e24ce4fc {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:24.813882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (71223b56-abf0-4c0b-adc0-5e35e24ce4fc), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.814201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Security group rule updated ['70be71a1-88a4-4353-bd88-3cd65a51fbf8'] Sep 30 09:47:24.814665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Resource SecurityGroupRule deleted: 93419c41-459e-426d-8aa6-7b44ca5263ed {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:24.815011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (93419c41-459e-426d-8aa6-7b44ca5263ed), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.815327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Security group rule updated ['70be71a1-88a4-4353-bd88-3cd65a51fbf8'] Sep 30 09:47:24.815695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Resource SecurityGroupRule deleted: b4f8279c-ee20-4ec0-a9e8-80e77c734dca {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:24.816156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b4f8279c-ee20-4ec0-a9e8-80e77c734dca), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:24.816482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-35eb7a02-3c49-4f40-89b9-fe7bb183b363 admin admin] Security group rule updated ['70be71a1-88a4-4353-bd88-3cd65a51fbf8'] Sep 30 09:47:25.552118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:25Z,description='Default security group',id=c316b910-55fe-44d2-941e-d365efcf7920,is_default=True,name='default',project_id='bb7164960bf24f24b7aed86e9e40130e',revision_number=1,rules=[SecurityGroupRule(5b1bf53a-b58c-4c0e-b781-24ecb621c3c0),SecurityGroupRule(adecff67-c394-4c56-ac54-12330047f1f0),SecurityGroupRule(af4f5591-4420-4283-9e53-4822324f5096),SecurityGroupRule(d7fa8303-b02f-44ff-a442-529bda698f7a)],shared=False,stateful=True,updated_at=2022-09-30T09:47:25Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:25.552666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (c316b910-55fe-44d2-941e-d365efcf7920), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.553516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:25Z,description=,direction='ingress',ethertype='IPv4',id=5b1bf53a-b58c-4c0e-b781-24ecb621c3c0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb7164960bf24f24b7aed86e9e40130e',protocol=,remote_address_group_id=,remote_group_id=c316b910-55fe-44d2-941e-d365efcf7920,remote_ip_prefix=,revision_number=0,security_group_id=c316b910-55fe-44d2-941e-d365efcf7920,updated_at=2022-09-30T09:47:25Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:25.553882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5b1bf53a-b58c-4c0e-b781-24ecb621c3c0), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.554220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Security group rule updated ['c316b910-55fe-44d2-941e-d365efcf7920'] Sep 30 09:47:25.554936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:25Z,description=,direction='egress',ethertype='IPv6',id=adecff67-c394-4c56-ac54-12330047f1f0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb7164960bf24f24b7aed86e9e40130e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c316b910-55fe-44d2-941e-d365efcf7920,updated_at=2022-09-30T09:47:25Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:25.555297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (adecff67-c394-4c56-ac54-12330047f1f0), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.555628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Security group rule updated ['c316b910-55fe-44d2-941e-d365efcf7920'] Sep 30 09:47:25.556295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:25Z,description=,direction='egress',ethertype='IPv4',id=af4f5591-4420-4283-9e53-4822324f5096,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb7164960bf24f24b7aed86e9e40130e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c316b910-55fe-44d2-941e-d365efcf7920,updated_at=2022-09-30T09:47:25Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:25.557702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (af4f5591-4420-4283-9e53-4822324f5096), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.557702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Security group rule updated ['c316b910-55fe-44d2-941e-d365efcf7920'] Sep 30 09:47:25.558154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:25Z,description=,direction='ingress',ethertype='IPv6',id=d7fa8303-b02f-44ff-a442-529bda698f7a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='bb7164960bf24f24b7aed86e9e40130e',protocol=,remote_address_group_id=,remote_group_id=c316b910-55fe-44d2-941e-d365efcf7920,remote_ip_prefix=,revision_number=0,security_group_id=c316b910-55fe-44d2-941e-d365efcf7920,updated_at=2022-09-30T09:47:25Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:25.558530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d7fa8303-b02f-44ff-a442-529bda698f7a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.558955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-57bb34be-048d-4ff0-a0ef-b0741027e0a8 admin admin] Security group rule updated ['c316b910-55fe-44d2-941e-d365efcf7920'] Sep 30 09:47:25.640317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Resource SecurityGroup deleted: 36a8dc30-8d9a-4b94-899b-74bfa1118bd6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:25.643166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (36a8dc30-8d9a-4b94-899b-74bfa1118bd6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.643166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('36a8dc30-8d9a-4b94-899b-74bfa1118bd6',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:25.658192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('36a8dc30-8d9a-4b94-899b-74bfa1118bd6',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:25.658714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Resource SecurityGroupRule deleted: 84cf0d03-0fd0-481d-9bd4-e9848e910694 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:25.660446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (84cf0d03-0fd0-481d-9bd4-e9848e910694), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.660446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Security group rule updated ['36a8dc30-8d9a-4b94-899b-74bfa1118bd6'] Sep 30 09:47:25.660446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Resource SecurityGroupRule deleted: 8838d7e6-4fdd-4cc9-86bb-9e03336d9452 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:25.660446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8838d7e6-4fdd-4cc9-86bb-9e03336d9452), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.660809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Security group rule updated ['36a8dc30-8d9a-4b94-899b-74bfa1118bd6'] Sep 30 09:47:25.660928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Resource SecurityGroupRule deleted: 9a409d20-e214-40ee-99d8-ecec0499f290 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:25.661273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (9a409d20-e214-40ee-99d8-ecec0499f290), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.661582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Security group rule updated ['36a8dc30-8d9a-4b94-899b-74bfa1118bd6'] Sep 30 09:47:25.661940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Resource SecurityGroupRule deleted: f456c664-a8a5-42ef-96ba-78d50996d4d5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:25.662272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f456c664-a8a5-42ef-96ba-78d50996d4d5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.662640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ffaac231-63fe-4f1b-9341-960ab6b969b4 admin admin] Security group rule updated ['36a8dc30-8d9a-4b94-899b-74bfa1118bd6'] Sep 30 09:47:25.797943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Resource SecurityGroup deleted: c316b910-55fe-44d2-941e-d365efcf7920 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:25.798565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (c316b910-55fe-44d2-941e-d365efcf7920), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.799081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c316b910-55fe-44d2-941e-d365efcf7920',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:25.816925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c316b910-55fe-44d2-941e-d365efcf7920',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:25.817365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Resource SecurityGroupRule deleted: 5b1bf53a-b58c-4c0e-b781-24ecb621c3c0 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:25.821017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5b1bf53a-b58c-4c0e-b781-24ecb621c3c0), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.821017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Security group rule updated ['c316b910-55fe-44d2-941e-d365efcf7920'] Sep 30 09:47:25.821017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Resource SecurityGroupRule deleted: adecff67-c394-4c56-ac54-12330047f1f0 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:25.821017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (adecff67-c394-4c56-ac54-12330047f1f0), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.821017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Security group rule updated ['c316b910-55fe-44d2-941e-d365efcf7920'] Sep 30 09:47:25.821691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Resource SecurityGroupRule deleted: af4f5591-4420-4283-9e53-4822324f5096 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:25.821691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (af4f5591-4420-4283-9e53-4822324f5096), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.821691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Security group rule updated ['c316b910-55fe-44d2-941e-d365efcf7920'] Sep 30 09:47:25.821691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Resource SecurityGroupRule deleted: d7fa8303-b02f-44ff-a442-529bda698f7a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:25.821691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d7fa8303-b02f-44ff-a442-529bda698f7a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:25.822081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6e2fd9eb-19a1-4dcb-bcee-fa89d74b6ea7 admin admin] Security group rule updated ['c316b910-55fe-44d2-941e-d365efcf7920'] Sep 30 09:47:26.274458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:296 started Sep 30 09:47:26.277549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=777000000,duration_sec=604,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:26.278134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:26.278488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:296 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:26.827637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:26Z,description='Default security group',id=2676ad30-8568-4f81-8020-426d7bbcdea3,is_default=True,name='default',project_id='578897d982ff44169a17f9d384c801d1',revision_number=1,rules=[SecurityGroupRule(195f9ce4-a5c4-4aed-9f4f-832f64933231),SecurityGroupRule(831264da-1f4e-4903-9f94-f637dc40047d),SecurityGroupRule(8a29a213-1d1a-43bd-a363-3fbdc5ad756b),SecurityGroupRule(e0c577eb-d7cd-48f2-8066-0f881c21ee32)],shared=False,stateful=True,updated_at=2022-09-30T09:47:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:26.828234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (2676ad30-8568-4f81-8020-426d7bbcdea3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:26.828709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:26Z,description=,direction='ingress',ethertype='IPv4',id=195f9ce4-a5c4-4aed-9f4f-832f64933231,normalized_cidr=None,port_range_max=,port_range_min=,project_id='578897d982ff44169a17f9d384c801d1',protocol=,remote_address_group_id=,remote_group_id=2676ad30-8568-4f81-8020-426d7bbcdea3,remote_ip_prefix=,revision_number=0,security_group_id=2676ad30-8568-4f81-8020-426d7bbcdea3,updated_at=2022-09-30T09:47:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:26.829070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (195f9ce4-a5c4-4aed-9f4f-832f64933231), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:26.829618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Security group rule updated ['2676ad30-8568-4f81-8020-426d7bbcdea3'] Sep 30 09:47:26.830295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:26Z,description=,direction='egress',ethertype='IPv4',id=831264da-1f4e-4903-9f94-f637dc40047d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='578897d982ff44169a17f9d384c801d1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2676ad30-8568-4f81-8020-426d7bbcdea3,updated_at=2022-09-30T09:47:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:26.830674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (831264da-1f4e-4903-9f94-f637dc40047d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:26.831010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Security group rule updated ['2676ad30-8568-4f81-8020-426d7bbcdea3'] Sep 30 09:47:26.831746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:26Z,description=,direction='egress',ethertype='IPv6',id=8a29a213-1d1a-43bd-a363-3fbdc5ad756b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='578897d982ff44169a17f9d384c801d1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2676ad30-8568-4f81-8020-426d7bbcdea3,updated_at=2022-09-30T09:47:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:26.832104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8a29a213-1d1a-43bd-a363-3fbdc5ad756b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:26.832431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Security group rule updated ['2676ad30-8568-4f81-8020-426d7bbcdea3'] Sep 30 09:47:26.833103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:26Z,description=,direction='ingress',ethertype='IPv6',id=e0c577eb-d7cd-48f2-8066-0f881c21ee32,normalized_cidr=None,port_range_max=,port_range_min=,project_id='578897d982ff44169a17f9d384c801d1',protocol=,remote_address_group_id=,remote_group_id=2676ad30-8568-4f81-8020-426d7bbcdea3,remote_ip_prefix=,revision_number=0,security_group_id=2676ad30-8568-4f81-8020-426d7bbcdea3,updated_at=2022-09-30T09:47:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:26.833571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e0c577eb-d7cd-48f2-8066-0f881c21ee32), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:26.833897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4c7198d8-ff71-496c-9c8b-e389fcd7743e admin admin] Security group rule updated ['2676ad30-8568-4f81-8020-426d7bbcdea3'] Sep 30 09:47:27.057044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Resource SecurityGroup deleted: 2676ad30-8568-4f81-8020-426d7bbcdea3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:27.057425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (2676ad30-8568-4f81-8020-426d7bbcdea3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:27.057891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2676ad30-8568-4f81-8020-426d7bbcdea3',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:27.074483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2676ad30-8568-4f81-8020-426d7bbcdea3',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:27.074483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Resource SecurityGroupRule deleted: 195f9ce4-a5c4-4aed-9f4f-832f64933231 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:27.074483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (195f9ce4-a5c4-4aed-9f4f-832f64933231), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:27.074483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Security group rule updated ['2676ad30-8568-4f81-8020-426d7bbcdea3'] Sep 30 09:47:27.075215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Resource SecurityGroupRule deleted: 831264da-1f4e-4903-9f94-f637dc40047d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:27.075215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (831264da-1f4e-4903-9f94-f637dc40047d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:27.075473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Security group rule updated ['2676ad30-8568-4f81-8020-426d7bbcdea3'] Sep 30 09:47:27.076497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Resource SecurityGroupRule deleted: 8a29a213-1d1a-43bd-a363-3fbdc5ad756b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:27.076845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8a29a213-1d1a-43bd-a363-3fbdc5ad756b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:27.077314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Security group rule updated ['2676ad30-8568-4f81-8020-426d7bbcdea3'] Sep 30 09:47:27.077730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Resource SecurityGroupRule deleted: e0c577eb-d7cd-48f2-8066-0f881c21ee32 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:27.078100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e0c577eb-d7cd-48f2-8066-0f881c21ee32), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:27.078413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-68dadd2d-35c4-4ea9-be63-58f931c4244c admin admin] Security group rule updated ['2676ad30-8568-4f81-8020-426d7bbcdea3'] Sep 30 09:47:28.275136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:297 started Sep 30 09:47:28.277597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03e6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=777000000,duration_sec=606,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:28.278157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:28.278501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:297 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:29.759592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:29Z,description='Default security group',id=38ee2acf-38e6-4852-95db-396d076fce35,is_default=True,name='default',project_id='8e87f05b71744abb926f7f4aad471e8d',revision_number=1,rules=[SecurityGroupRule(243125e9-93c2-48fd-a69a-7cdd18759a43),SecurityGroupRule(267d8c55-1be5-4f9d-a7a4-9a52eae19dae),SecurityGroupRule(40f7356c-94e1-46bd-a830-487f3b320339),SecurityGroupRule(b7b5d6b9-16ac-46eb-9202-b5c000e4ac10)],shared=False,stateful=True,updated_at=2022-09-30T09:47:29Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:29.760164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (38ee2acf-38e6-4852-95db-396d076fce35), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:29.760597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:29Z,description=,direction='ingress',ethertype='IPv4',id=243125e9-93c2-48fd-a69a-7cdd18759a43,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e87f05b71744abb926f7f4aad471e8d',protocol=,remote_address_group_id=,remote_group_id=38ee2acf-38e6-4852-95db-396d076fce35,remote_ip_prefix=,revision_number=0,security_group_id=38ee2acf-38e6-4852-95db-396d076fce35,updated_at=2022-09-30T09:47:29Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:29.760961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (243125e9-93c2-48fd-a69a-7cdd18759a43), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:29.761301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Security group rule updated ['38ee2acf-38e6-4852-95db-396d076fce35'] Sep 30 09:47:29.761979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:29Z,description=,direction='egress',ethertype='IPv4',id=267d8c55-1be5-4f9d-a7a4-9a52eae19dae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e87f05b71744abb926f7f4aad471e8d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38ee2acf-38e6-4852-95db-396d076fce35,updated_at=2022-09-30T09:47:29Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:29.762334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (267d8c55-1be5-4f9d-a7a4-9a52eae19dae), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:29.762689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Security group rule updated ['38ee2acf-38e6-4852-95db-396d076fce35'] Sep 30 09:47:29.763987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:29Z,description=,direction='ingress',ethertype='IPv6',id=40f7356c-94e1-46bd-a830-487f3b320339,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e87f05b71744abb926f7f4aad471e8d',protocol=,remote_address_group_id=,remote_group_id=38ee2acf-38e6-4852-95db-396d076fce35,remote_ip_prefix=,revision_number=0,security_group_id=38ee2acf-38e6-4852-95db-396d076fce35,updated_at=2022-09-30T09:47:29Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:29.764340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (40f7356c-94e1-46bd-a830-487f3b320339), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:29.764666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Security group rule updated ['38ee2acf-38e6-4852-95db-396d076fce35'] Sep 30 09:47:29.765324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:29Z,description=,direction='egress',ethertype='IPv6',id=b7b5d6b9-16ac-46eb-9202-b5c000e4ac10,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e87f05b71744abb926f7f4aad471e8d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38ee2acf-38e6-4852-95db-396d076fce35,updated_at=2022-09-30T09:47:29Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:29.765685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b7b5d6b9-16ac-46eb-9202-b5c000e4ac10), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:29.766010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e07efc04-f4cf-43aa-8509-86c17b3b4ef4 admin admin] Security group rule updated ['38ee2acf-38e6-4852-95db-396d076fce35'] Sep 30 09:47:30.065420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Resource SecurityGroup deleted: 38ee2acf-38e6-4852-95db-396d076fce35 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:30.065988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (38ee2acf-38e6-4852-95db-396d076fce35), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.066904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('38ee2acf-38e6-4852-95db-396d076fce35',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:30.082949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('38ee2acf-38e6-4852-95db-396d076fce35',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:30.084202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Resource SecurityGroupRule deleted: 243125e9-93c2-48fd-a69a-7cdd18759a43 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:30.084202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (243125e9-93c2-48fd-a69a-7cdd18759a43), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.084667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Security group rule updated ['38ee2acf-38e6-4852-95db-396d076fce35'] Sep 30 09:47:30.085248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Resource SecurityGroupRule deleted: 267d8c55-1be5-4f9d-a7a4-9a52eae19dae {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:30.085959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (267d8c55-1be5-4f9d-a7a4-9a52eae19dae), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.086500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Security group rule updated ['38ee2acf-38e6-4852-95db-396d076fce35'] Sep 30 09:47:30.087083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Resource SecurityGroupRule deleted: 40f7356c-94e1-46bd-a830-487f3b320339 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:30.087492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (40f7356c-94e1-46bd-a830-487f3b320339), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.087910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Security group rule updated ['38ee2acf-38e6-4852-95db-396d076fce35'] Sep 30 09:47:30.088379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Resource SecurityGroupRule deleted: b7b5d6b9-16ac-46eb-9202-b5c000e4ac10 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:30.088822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b7b5d6b9-16ac-46eb-9202-b5c000e4ac10), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.089239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bf1d1f27-9fbd-4c71-bb88-6e1d90417e72 admin admin] Security group rule updated ['38ee2acf-38e6-4852-95db-396d076fce35'] Sep 30 09:47:30.276595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:298 started Sep 30 09:47:30.281805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:30Z,description='Default security group',id=c55b71cc-f186-474c-a515-1a8984959421,is_default=True,name='default',project_id='697abea4080645008cdac2b13c2baf71',revision_number=1,rules=[SecurityGroupRule(8974ff68-1249-4137-8f15-0ef32ab7e151),SecurityGroupRule(a32a332e-c432-492d-aef6-84a1b95a47c4),SecurityGroupRule(c6f8868d-ffcd-4706-b899-868e8589a480),SecurityGroupRule(fbe6bf9d-6cbd-4da7-815d-57640071015a)],shared=False,stateful=True,updated_at=2022-09-30T09:47:30Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:30.282363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (c55b71cc-f186-474c-a515-1a8984959421), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.283177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:30Z,description=,direction='egress',ethertype='IPv6',id=8974ff68-1249-4137-8f15-0ef32ab7e151,normalized_cidr=None,port_range_max=,port_range_min=,project_id='697abea4080645008cdac2b13c2baf71',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c55b71cc-f186-474c-a515-1a8984959421,updated_at=2022-09-30T09:47:30Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:30.283541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8974ff68-1249-4137-8f15-0ef32ab7e151), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.283871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Security group rule updated ['c55b71cc-f186-474c-a515-1a8984959421'] Sep 30 09:47:30.284594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:30Z,description=,direction='egress',ethertype='IPv4',id=a32a332e-c432-492d-aef6-84a1b95a47c4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='697abea4080645008cdac2b13c2baf71',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c55b71cc-f186-474c-a515-1a8984959421,updated_at=2022-09-30T09:47:30Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:30.284946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a32a332e-c432-492d-aef6-84a1b95a47c4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.285428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Security group rule updated ['c55b71cc-f186-474c-a515-1a8984959421'] Sep 30 09:47:30.286081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:30Z,description=,direction='ingress',ethertype='IPv6',id=c6f8868d-ffcd-4706-b899-868e8589a480,normalized_cidr=None,port_range_max=,port_range_min=,project_id='697abea4080645008cdac2b13c2baf71',protocol=,remote_address_group_id=,remote_group_id=c55b71cc-f186-474c-a515-1a8984959421,remote_ip_prefix=,revision_number=0,security_group_id=c55b71cc-f186-474c-a515-1a8984959421,updated_at=2022-09-30T09:47:30Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:30.286432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c6f8868d-ffcd-4706-b899-868e8589a480), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.286801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Security group rule updated ['c55b71cc-f186-474c-a515-1a8984959421'] Sep 30 09:47:30.287456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:30Z,description=,direction='ingress',ethertype='IPv4',id=fbe6bf9d-6cbd-4da7-815d-57640071015a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='697abea4080645008cdac2b13c2baf71',protocol=,remote_address_group_id=,remote_group_id=c55b71cc-f186-474c-a515-1a8984959421,remote_ip_prefix=,revision_number=0,security_group_id=c55b71cc-f186-474c-a515-1a8984959421,updated_at=2022-09-30T09:47:30Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:30.287807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (fbe6bf9d-6cbd-4da7-815d-57640071015a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.288150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-66db14bb-01df-4cf2-9407-65fc4190a0bc admin admin] Security group rule updated ['c55b71cc-f186-474c-a515-1a8984959421'] Sep 30 09:47:30.290192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03e8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=781000000,duration_sec=608,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:30.290791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:30.291141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:298 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 30 09:47:30.495418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Resource SecurityGroup deleted: c55b71cc-f186-474c-a515-1a8984959421 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:30.495795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (c55b71cc-f186-474c-a515-1a8984959421), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.496250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c55b71cc-f186-474c-a515-1a8984959421',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:30.510415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c55b71cc-f186-474c-a515-1a8984959421',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:30.510631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Resource SecurityGroupRule deleted: 8974ff68-1249-4137-8f15-0ef32ab7e151 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:30.510891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8974ff68-1249-4137-8f15-0ef32ab7e151), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.511252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Security group rule updated ['c55b71cc-f186-474c-a515-1a8984959421'] Sep 30 09:47:30.511639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Resource SecurityGroupRule deleted: a32a332e-c432-492d-aef6-84a1b95a47c4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:30.511986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a32a332e-c432-492d-aef6-84a1b95a47c4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.512304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Security group rule updated ['c55b71cc-f186-474c-a515-1a8984959421'] Sep 30 09:47:30.512667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Resource SecurityGroupRule deleted: c6f8868d-ffcd-4706-b899-868e8589a480 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:30.513146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c6f8868d-ffcd-4706-b899-868e8589a480), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.513458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Security group rule updated ['c55b71cc-f186-474c-a515-1a8984959421'] Sep 30 09:47:30.513855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Resource SecurityGroupRule deleted: fbe6bf9d-6cbd-4da7-815d-57640071015a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:30.514193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (fbe6bf9d-6cbd-4da7-815d-57640071015a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:30.514716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d0478598-f8c5-4e10-ba07-9458adb06b58 admin admin] Security group rule updated ['c55b71cc-f186-474c-a515-1a8984959421'] Sep 30 09:47:31.368825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:31Z,description='Default security group',id=66db0461-2564-4b75-b50f-1ee495d32127,is_default=True,name='default',project_id='68a56179fff34e0bac65384b683e7b83',revision_number=1,rules=[SecurityGroupRule(14fe740a-405a-4792-9fe8-3f4a10785de4),SecurityGroupRule(36550bfd-9b86-4b0d-a580-29084f7d6dc7),SecurityGroupRule(c622220e-1e65-4f9a-9445-24a4f0af2d23),SecurityGroupRule(c818eab7-12bb-43ac-aa7a-61de06770202)],shared=False,stateful=True,updated_at=2022-09-30T09:47:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:31.370722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (66db0461-2564-4b75-b50f-1ee495d32127), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:31.371589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:31Z,description=,direction='ingress',ethertype='IPv6',id=14fe740a-405a-4792-9fe8-3f4a10785de4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='68a56179fff34e0bac65384b683e7b83',protocol=,remote_address_group_id=,remote_group_id=66db0461-2564-4b75-b50f-1ee495d32127,remote_ip_prefix=,revision_number=0,security_group_id=66db0461-2564-4b75-b50f-1ee495d32127,updated_at=2022-09-30T09:47:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:31.372156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (14fe740a-405a-4792-9fe8-3f4a10785de4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:31.372665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Security group rule updated ['66db0461-2564-4b75-b50f-1ee495d32127'] Sep 30 09:47:31.373667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:31Z,description=,direction='egress',ethertype='IPv6',id=36550bfd-9b86-4b0d-a580-29084f7d6dc7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='68a56179fff34e0bac65384b683e7b83',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=66db0461-2564-4b75-b50f-1ee495d32127,updated_at=2022-09-30T09:47:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:31.374492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (36550bfd-9b86-4b0d-a580-29084f7d6dc7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:31.375038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Security group rule updated ['66db0461-2564-4b75-b50f-1ee495d32127'] Sep 30 09:47:31.375981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:31Z,description=,direction='ingress',ethertype='IPv4',id=c622220e-1e65-4f9a-9445-24a4f0af2d23,normalized_cidr=None,port_range_max=,port_range_min=,project_id='68a56179fff34e0bac65384b683e7b83',protocol=,remote_address_group_id=,remote_group_id=66db0461-2564-4b75-b50f-1ee495d32127,remote_ip_prefix=,revision_number=0,security_group_id=66db0461-2564-4b75-b50f-1ee495d32127,updated_at=2022-09-30T09:47:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:31.376543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c622220e-1e65-4f9a-9445-24a4f0af2d23), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:31.377080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Security group rule updated ['66db0461-2564-4b75-b50f-1ee495d32127'] Sep 30 09:47:31.378228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:31Z,description=,direction='egress',ethertype='IPv4',id=c818eab7-12bb-43ac-aa7a-61de06770202,normalized_cidr=None,port_range_max=,port_range_min=,project_id='68a56179fff34e0bac65384b683e7b83',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=66db0461-2564-4b75-b50f-1ee495d32127,updated_at=2022-09-30T09:47:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:31.378814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c818eab7-12bb-43ac-aa7a-61de06770202), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:31.379346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2c99df2a-0215-41f9-b792-c6f9ad54f12c admin admin] Security group rule updated ['66db0461-2564-4b75-b50f-1ee495d32127'] Sep 30 09:47:31.574883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Resource SecurityGroup deleted: 66db0461-2564-4b75-b50f-1ee495d32127 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:31.575854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (66db0461-2564-4b75-b50f-1ee495d32127), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:31.576390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('66db0461-2564-4b75-b50f-1ee495d32127',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:31.588958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('66db0461-2564-4b75-b50f-1ee495d32127',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:31.589398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Resource SecurityGroupRule deleted: 14fe740a-405a-4792-9fe8-3f4a10785de4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:31.589763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (14fe740a-405a-4792-9fe8-3f4a10785de4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:31.590111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Security group rule updated ['66db0461-2564-4b75-b50f-1ee495d32127'] Sep 30 09:47:31.590507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Resource SecurityGroupRule deleted: 36550bfd-9b86-4b0d-a580-29084f7d6dc7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:31.590881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (36550bfd-9b86-4b0d-a580-29084f7d6dc7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:31.591757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Security group rule updated ['66db0461-2564-4b75-b50f-1ee495d32127'] Sep 30 09:47:31.592127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Resource SecurityGroupRule deleted: c622220e-1e65-4f9a-9445-24a4f0af2d23 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:31.592482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c622220e-1e65-4f9a-9445-24a4f0af2d23), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:31.592800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Security group rule updated ['66db0461-2564-4b75-b50f-1ee495d32127'] Sep 30 09:47:31.593163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Resource SecurityGroupRule deleted: c818eab7-12bb-43ac-aa7a-61de06770202 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:31.595177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c818eab7-12bb-43ac-aa7a-61de06770202), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:31.600493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e562089b-ceeb-44a2-a209-b8e448553ee5 admin admin] Security group rule updated ['66db0461-2564-4b75-b50f-1ee495d32127'] Sep 30 09:47:32.277949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:299 started Sep 30 09:47:32.280914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=781000000,duration_sec=610,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:32.281510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:32.281860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:299 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:34.279193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:300 started Sep 30 09:47:34.281576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=781000000,duration_sec=612,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:34.282149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:34.282480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:300 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:47:36.280822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:301 started Sep 30 09:47:36.283354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03ee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=783000000,duration_sec=614,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:36.283918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:36.284262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:301 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:38.281625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:302 started Sep 30 09:47:38.283938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=784000000,duration_sec=616,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:38.284502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:38.284881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:302 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:47:40.282489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:303 started Sep 30 09:47:40.285240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03f2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=785000000,duration_sec=618,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:40.285825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:40.286173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:303 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:42.283503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:304 started Sep 30 09:47:42.285943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03f4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=786000000,duration_sec=620,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:42.286529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:42.286909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:304 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:44.284023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:305 started Sep 30 09:47:44.286578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=786000000,duration_sec=622,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:44.287234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:44.287583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:305 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:46.284540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:306 started Sep 30 09:47:46.286956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03f8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=787000000,duration_sec=624,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:46.287517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:46.287866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:306 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:48.286850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:307 started Sep 30 09:47:48.290817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03fa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=789000000,duration_sec=626,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:48.291473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:48.291821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:307 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:47:49.098276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:48Z,description='Default security group',id=56529d8a-12fb-4907-9af9-f1c839c961d5,is_default=True,name='default',project_id='b39a7111b78845219da0f1c53007fc4a',revision_number=1,rules=[SecurityGroupRule(47ab25da-a542-45e4-a4ac-67401b735454),SecurityGroupRule(73921b6c-4064-489d-8a3f-a3383c496d5b),SecurityGroupRule(7baf96bb-edd5-43a5-a14b-359dbd10bedf),SecurityGroupRule(9cc6dec7-9399-4f9a-92a5-d926df8fdc2c)],shared=False,stateful=True,updated_at=2022-09-30T09:47:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:49.098676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (56529d8a-12fb-4907-9af9-f1c839c961d5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:49.099318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:48Z,description=,direction='egress',ethertype='IPv6',id=47ab25da-a542-45e4-a4ac-67401b735454,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b39a7111b78845219da0f1c53007fc4a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=56529d8a-12fb-4907-9af9-f1c839c961d5,updated_at=2022-09-30T09:47:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:49.099669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (47ab25da-a542-45e4-a4ac-67401b735454), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:49.100065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Security group rule updated ['56529d8a-12fb-4907-9af9-f1c839c961d5'] Sep 30 09:47:49.100697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:48Z,description=,direction='ingress',ethertype='IPv4',id=73921b6c-4064-489d-8a3f-a3383c496d5b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b39a7111b78845219da0f1c53007fc4a',protocol=,remote_address_group_id=,remote_group_id=56529d8a-12fb-4907-9af9-f1c839c961d5,remote_ip_prefix=,revision_number=0,security_group_id=56529d8a-12fb-4907-9af9-f1c839c961d5,updated_at=2022-09-30T09:47:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:49.101047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (73921b6c-4064-489d-8a3f-a3383c496d5b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:49.101370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Security group rule updated ['56529d8a-12fb-4907-9af9-f1c839c961d5'] Sep 30 09:47:49.102025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:48Z,description=,direction='ingress',ethertype='IPv6',id=7baf96bb-edd5-43a5-a14b-359dbd10bedf,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b39a7111b78845219da0f1c53007fc4a',protocol=,remote_address_group_id=,remote_group_id=56529d8a-12fb-4907-9af9-f1c839c961d5,remote_ip_prefix=,revision_number=0,security_group_id=56529d8a-12fb-4907-9af9-f1c839c961d5,updated_at=2022-09-30T09:47:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:49.102369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7baf96bb-edd5-43a5-a14b-359dbd10bedf), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:49.102721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Security group rule updated ['56529d8a-12fb-4907-9af9-f1c839c961d5'] Sep 30 09:47:49.103371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:48Z,description=,direction='egress',ethertype='IPv4',id=9cc6dec7-9399-4f9a-92a5-d926df8fdc2c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b39a7111b78845219da0f1c53007fc4a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=56529d8a-12fb-4907-9af9-f1c839c961d5,updated_at=2022-09-30T09:47:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:49.103768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (9cc6dec7-9399-4f9a-92a5-d926df8fdc2c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:49.104021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-75e9bc56-8e33-4022-87d7-e333e9c5e53a admin admin] Security group rule updated ['56529d8a-12fb-4907-9af9-f1c839c961d5'] Sep 30 09:47:49.303054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Resource SecurityGroup deleted: 56529d8a-12fb-4907-9af9-f1c839c961d5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:49.303626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (56529d8a-12fb-4907-9af9-f1c839c961d5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:49.304028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('56529d8a-12fb-4907-9af9-f1c839c961d5',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:49.320923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('56529d8a-12fb-4907-9af9-f1c839c961d5',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:49.322396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Resource SecurityGroupRule deleted: 47ab25da-a542-45e4-a4ac-67401b735454 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:49.322862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (47ab25da-a542-45e4-a4ac-67401b735454), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:49.323253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Security group rule updated ['56529d8a-12fb-4907-9af9-f1c839c961d5'] Sep 30 09:47:49.323800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Resource SecurityGroupRule deleted: 73921b6c-4064-489d-8a3f-a3383c496d5b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:49.324195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (73921b6c-4064-489d-8a3f-a3383c496d5b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:49.324739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Security group rule updated ['56529d8a-12fb-4907-9af9-f1c839c961d5'] Sep 30 09:47:49.325317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Resource SecurityGroupRule deleted: 7baf96bb-edd5-43a5-a14b-359dbd10bedf {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:49.325726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7baf96bb-edd5-43a5-a14b-359dbd10bedf), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:49.326056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Security group rule updated ['56529d8a-12fb-4907-9af9-f1c839c961d5'] Sep 30 09:47:49.326993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Resource SecurityGroupRule deleted: 9cc6dec7-9399-4f9a-92a5-d926df8fdc2c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:49.327336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (9cc6dec7-9399-4f9a-92a5-d926df8fdc2c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:49.327657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ca779ac3-c940-4d55-8f94-0519dbd9a6fe admin admin] Security group rule updated ['56529d8a-12fb-4907-9af9-f1c839c961d5'] Sep 30 09:47:50.050117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:49Z,description='Default security group',id=32462bc0-e583-46cc-910f-b37320070de7,is_default=True,name='default',project_id='76a9523355aa44049fe91113df562bc1',revision_number=1,rules=[SecurityGroupRule(85736c2f-24ff-4b6f-99d2-f287f6476da6),SecurityGroupRule(9cd2f14d-b91f-414e-a0e1-790c5f4c747d),SecurityGroupRule(a1ad0624-3666-4f6d-8127-4a60d7061c15),SecurityGroupRule(d3217399-15b3-4c8d-8dfa-118b1bcb9a5b)],shared=False,stateful=True,updated_at=2022-09-30T09:47:49Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:50.053495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (32462bc0-e583-46cc-910f-b37320070de7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.053495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:49Z,description=,direction='ingress',ethertype='IPv4',id=85736c2f-24ff-4b6f-99d2-f287f6476da6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='76a9523355aa44049fe91113df562bc1',protocol=,remote_address_group_id=,remote_group_id=32462bc0-e583-46cc-910f-b37320070de7,remote_ip_prefix=,revision_number=0,security_group_id=32462bc0-e583-46cc-910f-b37320070de7,updated_at=2022-09-30T09:47:49Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:50.053495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (85736c2f-24ff-4b6f-99d2-f287f6476da6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.054190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Security group rule updated ['32462bc0-e583-46cc-910f-b37320070de7'] Sep 30 09:47:50.055442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:49Z,description=,direction='egress',ethertype='IPv6',id=9cd2f14d-b91f-414e-a0e1-790c5f4c747d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='76a9523355aa44049fe91113df562bc1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=32462bc0-e583-46cc-910f-b37320070de7,updated_at=2022-09-30T09:47:49Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:50.056330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (9cd2f14d-b91f-414e-a0e1-790c5f4c747d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.056924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Security group rule updated ['32462bc0-e583-46cc-910f-b37320070de7'] Sep 30 09:47:50.057788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:49Z,description=,direction='ingress',ethertype='IPv6',id=a1ad0624-3666-4f6d-8127-4a60d7061c15,normalized_cidr=None,port_range_max=,port_range_min=,project_id='76a9523355aa44049fe91113df562bc1',protocol=,remote_address_group_id=,remote_group_id=32462bc0-e583-46cc-910f-b37320070de7,remote_ip_prefix=,revision_number=0,security_group_id=32462bc0-e583-46cc-910f-b37320070de7,updated_at=2022-09-30T09:47:49Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:50.058493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a1ad0624-3666-4f6d-8127-4a60d7061c15), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.059390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Security group rule updated ['32462bc0-e583-46cc-910f-b37320070de7'] Sep 30 09:47:50.060752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:49Z,description=,direction='egress',ethertype='IPv4',id=d3217399-15b3-4c8d-8dfa-118b1bcb9a5b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='76a9523355aa44049fe91113df562bc1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=32462bc0-e583-46cc-910f-b37320070de7,updated_at=2022-09-30T09:47:49Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:50.061320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d3217399-15b3-4c8d-8dfa-118b1bcb9a5b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.061859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a772f02d-07a5-4dcf-8f0f-4673dfbccef6 admin admin] Security group rule updated ['32462bc0-e583-46cc-910f-b37320070de7'] Sep 30 09:47:50.212750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:49Z,description='Default security group',id=b625d02c-2402-4d71-92a4-2e14bcf26d51,is_default=True,name='default',project_id='584de4573964403fb0bace83b40e0761',revision_number=1,rules=[SecurityGroupRule(296dea51-aa61-4167-9824-810ffc5101ea),SecurityGroupRule(7f07e76a-8a24-4e0c-8e8a-a1a98e32745d),SecurityGroupRule(c236c8d2-5e53-4bee-96e9-b30b02b1b33f),SecurityGroupRule(fa5a602b-04f0-4bc6-9464-50be5eaced0c)],shared=False,stateful=True,updated_at=2022-09-30T09:47:49Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:50.213294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (b625d02c-2402-4d71-92a4-2e14bcf26d51), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.213937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:49Z,description=,direction='egress',ethertype='IPv4',id=296dea51-aa61-4167-9824-810ffc5101ea,normalized_cidr=None,port_range_max=,port_range_min=,project_id='584de4573964403fb0bace83b40e0761',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b625d02c-2402-4d71-92a4-2e14bcf26d51,updated_at=2022-09-30T09:47:49Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:50.214439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (296dea51-aa61-4167-9824-810ffc5101ea), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.214995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Security group rule updated ['b625d02c-2402-4d71-92a4-2e14bcf26d51'] Sep 30 09:47:50.216167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:50Z,description=,direction='ingress',ethertype='IPv6',id=7f07e76a-8a24-4e0c-8e8a-a1a98e32745d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='584de4573964403fb0bace83b40e0761',protocol=,remote_address_group_id=,remote_group_id=b625d02c-2402-4d71-92a4-2e14bcf26d51,remote_ip_prefix=,revision_number=0,security_group_id=b625d02c-2402-4d71-92a4-2e14bcf26d51,updated_at=2022-09-30T09:47:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:50.216724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7f07e76a-8a24-4e0c-8e8a-a1a98e32745d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.217114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Security group rule updated ['b625d02c-2402-4d71-92a4-2e14bcf26d51'] Sep 30 09:47:50.218399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:49Z,description=,direction='ingress',ethertype='IPv4',id=c236c8d2-5e53-4bee-96e9-b30b02b1b33f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='584de4573964403fb0bace83b40e0761',protocol=,remote_address_group_id=,remote_group_id=b625d02c-2402-4d71-92a4-2e14bcf26d51,remote_ip_prefix=,revision_number=0,security_group_id=b625d02c-2402-4d71-92a4-2e14bcf26d51,updated_at=2022-09-30T09:47:49Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:50.218804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c236c8d2-5e53-4bee-96e9-b30b02b1b33f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.219138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Security group rule updated ['b625d02c-2402-4d71-92a4-2e14bcf26d51'] Sep 30 09:47:50.219804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:50Z,description=,direction='egress',ethertype='IPv6',id=fa5a602b-04f0-4bc6-9464-50be5eaced0c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='584de4573964403fb0bace83b40e0761',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b625d02c-2402-4d71-92a4-2e14bcf26d51,updated_at=2022-09-30T09:47:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:50.220161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (fa5a602b-04f0-4bc6-9464-50be5eaced0c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.220519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3e4447cf-f222-4da1-a764-b2846b298eeb admin admin] Security group rule updated ['b625d02c-2402-4d71-92a4-2e14bcf26d51'] Sep 30 09:47:50.286897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:308 started Sep 30 09:47:50.292131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03fc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=791000000,duration_sec=628,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:50.292821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:50.293248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:308 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:47:50.314348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Resource SecurityGroup deleted: 32462bc0-e583-46cc-910f-b37320070de7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:50.314944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (32462bc0-e583-46cc-910f-b37320070de7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.315957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('32462bc0-e583-46cc-910f-b37320070de7',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:50.354949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('32462bc0-e583-46cc-910f-b37320070de7',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:50.355388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Resource SecurityGroupRule deleted: 85736c2f-24ff-4b6f-99d2-f287f6476da6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:50.355750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (85736c2f-24ff-4b6f-99d2-f287f6476da6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.356573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Security group rule updated ['32462bc0-e583-46cc-910f-b37320070de7'] Sep 30 09:47:50.357290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Resource SecurityGroupRule deleted: 9cd2f14d-b91f-414e-a0e1-790c5f4c747d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:50.357639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (9cd2f14d-b91f-414e-a0e1-790c5f4c747d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.358151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Security group rule updated ['32462bc0-e583-46cc-910f-b37320070de7'] Sep 30 09:47:50.358621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Resource SecurityGroupRule deleted: a1ad0624-3666-4f6d-8127-4a60d7061c15 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:50.359091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a1ad0624-3666-4f6d-8127-4a60d7061c15), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.359540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Security group rule updated ['32462bc0-e583-46cc-910f-b37320070de7'] Sep 30 09:47:50.360071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Resource SecurityGroupRule deleted: d3217399-15b3-4c8d-8dfa-118b1bcb9a5b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:50.360584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d3217399-15b3-4c8d-8dfa-118b1bcb9a5b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.360896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-effd97c8-5c49-454c-873f-8047b7f9c473 admin admin] Security group rule updated ['32462bc0-e583-46cc-910f-b37320070de7'] Sep 30 09:47:50.629821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Resource SecurityGroup deleted: b625d02c-2402-4d71-92a4-2e14bcf26d51 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:50.630194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (b625d02c-2402-4d71-92a4-2e14bcf26d51), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.630676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b625d02c-2402-4d71-92a4-2e14bcf26d51',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:50.644219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b625d02c-2402-4d71-92a4-2e14bcf26d51',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:50.644652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Resource SecurityGroupRule deleted: 296dea51-aa61-4167-9824-810ffc5101ea {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:50.645023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (296dea51-aa61-4167-9824-810ffc5101ea), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.645359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Security group rule updated ['b625d02c-2402-4d71-92a4-2e14bcf26d51'] Sep 30 09:47:50.645746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Resource SecurityGroupRule deleted: 7f07e76a-8a24-4e0c-8e8a-a1a98e32745d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:50.646097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7f07e76a-8a24-4e0c-8e8a-a1a98e32745d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.646498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Security group rule updated ['b625d02c-2402-4d71-92a4-2e14bcf26d51'] Sep 30 09:47:50.646833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Resource SecurityGroupRule deleted: c236c8d2-5e53-4bee-96e9-b30b02b1b33f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:50.652472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c236c8d2-5e53-4bee-96e9-b30b02b1b33f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.652472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Security group rule updated ['b625d02c-2402-4d71-92a4-2e14bcf26d51'] Sep 30 09:47:50.652472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Resource SecurityGroupRule deleted: fa5a602b-04f0-4bc6-9464-50be5eaced0c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:50.652472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (fa5a602b-04f0-4bc6-9464-50be5eaced0c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:50.652472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5f88380d-8c87-412e-8ac7-c3ea90f6e8fc admin admin] Security group rule updated ['b625d02c-2402-4d71-92a4-2e14bcf26d51'] Sep 30 09:47:51.348762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:51Z,description='Default security group',id=8cf7d09c-e27e-4c99-854e-1d0ba3a97821,is_default=True,name='default',project_id='0860efc0d2584be78c2b46f937ebe7cf',revision_number=1,rules=[SecurityGroupRule(09deb69a-0442-4cfb-a13c-d80c128b0f1e),SecurityGroupRule(1ba96a06-cf19-4703-8681-ac9553c70995),SecurityGroupRule(2d3dd793-2861-42b0-9228-9d37161ac05d),SecurityGroupRule(b4d8aeb0-3a5f-4897-a044-f9b885a35519)],shared=False,stateful=True,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:51.349774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (8cf7d09c-e27e-4c99-854e-1d0ba3a97821), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.350569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:51Z,description=,direction='ingress',ethertype='IPv6',id=09deb69a-0442-4cfb-a13c-d80c128b0f1e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0860efc0d2584be78c2b46f937ebe7cf',protocol=,remote_address_group_id=,remote_group_id=8cf7d09c-e27e-4c99-854e-1d0ba3a97821,remote_ip_prefix=,revision_number=0,security_group_id=8cf7d09c-e27e-4c99-854e-1d0ba3a97821,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:51.351222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (09deb69a-0442-4cfb-a13c-d80c128b0f1e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.351712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Security group rule updated ['8cf7d09c-e27e-4c99-854e-1d0ba3a97821'] Sep 30 09:47:51.352723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:51Z,description=,direction='ingress',ethertype='IPv4',id=1ba96a06-cf19-4703-8681-ac9553c70995,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0860efc0d2584be78c2b46f937ebe7cf',protocol=,remote_address_group_id=,remote_group_id=8cf7d09c-e27e-4c99-854e-1d0ba3a97821,remote_ip_prefix=,revision_number=0,security_group_id=8cf7d09c-e27e-4c99-854e-1d0ba3a97821,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:51.353233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (1ba96a06-cf19-4703-8681-ac9553c70995), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.353713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Security group rule updated ['8cf7d09c-e27e-4c99-854e-1d0ba3a97821'] Sep 30 09:47:51.355190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:51Z,description=,direction='egress',ethertype='IPv6',id=2d3dd793-2861-42b0-9228-9d37161ac05d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0860efc0d2584be78c2b46f937ebe7cf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8cf7d09c-e27e-4c99-854e-1d0ba3a97821,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:51.355860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2d3dd793-2861-42b0-9228-9d37161ac05d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.356326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Security group rule updated ['8cf7d09c-e27e-4c99-854e-1d0ba3a97821'] Sep 30 09:47:51.360771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:51Z,description=,direction='egress',ethertype='IPv4',id=b4d8aeb0-3a5f-4897-a044-f9b885a35519,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0860efc0d2584be78c2b46f937ebe7cf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8cf7d09c-e27e-4c99-854e-1d0ba3a97821,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:51.361650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b4d8aeb0-3a5f-4897-a044-f9b885a35519), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.362144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec1df206-2c7e-4f84-b19e-b67619e33021 admin admin] Security group rule updated ['8cf7d09c-e27e-4c99-854e-1d0ba3a97821'] Sep 30 09:47:51.684800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Resource SecurityGroup deleted: 8cf7d09c-e27e-4c99-854e-1d0ba3a97821 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:51.685268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (8cf7d09c-e27e-4c99-854e-1d0ba3a97821), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.685874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8cf7d09c-e27e-4c99-854e-1d0ba3a97821',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:51.703569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8cf7d09c-e27e-4c99-854e-1d0ba3a97821',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:51.703569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Resource SecurityGroupRule deleted: 09deb69a-0442-4cfb-a13c-d80c128b0f1e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:51.703569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (09deb69a-0442-4cfb-a13c-d80c128b0f1e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.703569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Security group rule updated ['8cf7d09c-e27e-4c99-854e-1d0ba3a97821'] Sep 30 09:47:51.704480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Resource SecurityGroupRule deleted: 1ba96a06-cf19-4703-8681-ac9553c70995 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:51.705300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (1ba96a06-cf19-4703-8681-ac9553c70995), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.705832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Security group rule updated ['8cf7d09c-e27e-4c99-854e-1d0ba3a97821'] Sep 30 09:47:51.706392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Resource SecurityGroupRule deleted: 2d3dd793-2861-42b0-9228-9d37161ac05d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:51.706956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2d3dd793-2861-42b0-9228-9d37161ac05d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.707468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Security group rule updated ['8cf7d09c-e27e-4c99-854e-1d0ba3a97821'] Sep 30 09:47:51.708155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Resource SecurityGroupRule deleted: b4d8aeb0-3a5f-4897-a044-f9b885a35519 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:51.708728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b4d8aeb0-3a5f-4897-a044-f9b885a35519), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.709245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6c113a2f-4854-4624-8720-3729a2a832ef admin admin] Security group rule updated ['8cf7d09c-e27e-4c99-854e-1d0ba3a97821'] Sep 30 09:47:51.720146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:51Z,description='Default security group',id=5c2efad8-edcb-4176-a321-c657f3109688,is_default=True,name='default',project_id='2829024de36b4ad89d3d1173a7cc3c37',revision_number=1,rules=[SecurityGroupRule(4f0cfa44-d37a-48fa-9712-69c3cd2aa404),SecurityGroupRule(535d4f83-0110-44ac-8863-0dc5ba41fa4d),SecurityGroupRule(b58633f3-d5b3-4773-ad66-68806c7d02ec),SecurityGroupRule(c567965e-a5eb-474e-b811-82801a9b7305)],shared=False,stateful=True,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:51.720521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (5c2efad8-edcb-4176-a321-c657f3109688), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.721153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:51Z,description=,direction='ingress',ethertype='IPv4',id=4f0cfa44-d37a-48fa-9712-69c3cd2aa404,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2829024de36b4ad89d3d1173a7cc3c37',protocol=,remote_address_group_id=,remote_group_id=5c2efad8-edcb-4176-a321-c657f3109688,remote_ip_prefix=,revision_number=0,security_group_id=5c2efad8-edcb-4176-a321-c657f3109688,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:51.721508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4f0cfa44-d37a-48fa-9712-69c3cd2aa404), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.722006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Security group rule updated ['5c2efad8-edcb-4176-a321-c657f3109688'] Sep 30 09:47:51.722880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:51Z,description=,direction='ingress',ethertype='IPv6',id=535d4f83-0110-44ac-8863-0dc5ba41fa4d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2829024de36b4ad89d3d1173a7cc3c37',protocol=,remote_address_group_id=,remote_group_id=5c2efad8-edcb-4176-a321-c657f3109688,remote_ip_prefix=,revision_number=0,security_group_id=5c2efad8-edcb-4176-a321-c657f3109688,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:51.723717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (535d4f83-0110-44ac-8863-0dc5ba41fa4d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.724050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Security group rule updated ['5c2efad8-edcb-4176-a321-c657f3109688'] Sep 30 09:47:51.725155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:51Z,description=,direction='egress',ethertype='IPv4',id=b58633f3-d5b3-4773-ad66-68806c7d02ec,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2829024de36b4ad89d3d1173a7cc3c37',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5c2efad8-edcb-4176-a321-c657f3109688,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:51.725499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b58633f3-d5b3-4773-ad66-68806c7d02ec), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.725821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Security group rule updated ['5c2efad8-edcb-4176-a321-c657f3109688'] Sep 30 09:47:51.726703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:51Z,description=,direction='egress',ethertype='IPv6',id=c567965e-a5eb-474e-b811-82801a9b7305,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2829024de36b4ad89d3d1173a7cc3c37',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5c2efad8-edcb-4176-a321-c657f3109688,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:51.727186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c567965e-a5eb-474e-b811-82801a9b7305), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:51.727517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-19876643-cf46-4661-b69b-373c2245586b admin admin] Security group rule updated ['5c2efad8-edcb-4176-a321-c657f3109688'] Sep 30 09:47:52.006535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Resource SecurityGroup deleted: 5c2efad8-edcb-4176-a321-c657f3109688 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:52.006535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (5c2efad8-edcb-4176-a321-c657f3109688), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.006535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5c2efad8-edcb-4176-a321-c657f3109688',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:52.016960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5c2efad8-edcb-4176-a321-c657f3109688',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:52.017477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Resource SecurityGroupRule deleted: 4f0cfa44-d37a-48fa-9712-69c3cd2aa404 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:52.017831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4f0cfa44-d37a-48fa-9712-69c3cd2aa404), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.018159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Security group rule updated ['5c2efad8-edcb-4176-a321-c657f3109688'] Sep 30 09:47:52.018540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Resource SecurityGroupRule deleted: 535d4f83-0110-44ac-8863-0dc5ba41fa4d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:52.018972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (535d4f83-0110-44ac-8863-0dc5ba41fa4d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.019286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Security group rule updated ['5c2efad8-edcb-4176-a321-c657f3109688'] Sep 30 09:47:52.019646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Resource SecurityGroupRule deleted: b58633f3-d5b3-4773-ad66-68806c7d02ec {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:52.019979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b58633f3-d5b3-4773-ad66-68806c7d02ec), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.020286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Security group rule updated ['5c2efad8-edcb-4176-a321-c657f3109688'] Sep 30 09:47:52.020640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Resource SecurityGroupRule deleted: c567965e-a5eb-474e-b811-82801a9b7305 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:52.020970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c567965e-a5eb-474e-b811-82801a9b7305), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.021299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b2feb673-47c2-4715-b573-1fba3675cd18 admin admin] Security group rule updated ['5c2efad8-edcb-4176-a321-c657f3109688'] Sep 30 09:47:52.100307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:51Z,description='Default security group',id=72f2229f-a819-43f0-8eb9-f395d1783e5e,is_default=True,name='default',project_id='aba854709eb547f9b7998ff458a00168',revision_number=1,rules=[SecurityGroupRule(2ece4446-2547-43e2-935a-5bfb87b03999),SecurityGroupRule(8f1284de-7884-4f92-83f8-e29bbd43e0ad),SecurityGroupRule(f6ebe356-0e11-42e4-b64e-602ce3d8d3ca),SecurityGroupRule(f6f841ff-b0c8-4b69-825b-9317b617530a)],shared=False,stateful=True,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:52.100726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (72f2229f-a819-43f0-8eb9-f395d1783e5e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.106635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:51Z,description=,direction='ingress',ethertype='IPv6',id=2ece4446-2547-43e2-935a-5bfb87b03999,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aba854709eb547f9b7998ff458a00168',protocol=,remote_address_group_id=,remote_group_id=72f2229f-a819-43f0-8eb9-f395d1783e5e,remote_ip_prefix=,revision_number=0,security_group_id=72f2229f-a819-43f0-8eb9-f395d1783e5e,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:52.106635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2ece4446-2547-43e2-935a-5bfb87b03999), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.106635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Security group rule updated ['72f2229f-a819-43f0-8eb9-f395d1783e5e'] Sep 30 09:47:52.106909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:51Z,description=,direction='egress',ethertype='IPv4',id=8f1284de-7884-4f92-83f8-e29bbd43e0ad,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aba854709eb547f9b7998ff458a00168',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=72f2229f-a819-43f0-8eb9-f395d1783e5e,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:52.106909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8f1284de-7884-4f92-83f8-e29bbd43e0ad), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.106909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Security group rule updated ['72f2229f-a819-43f0-8eb9-f395d1783e5e'] Sep 30 09:47:52.107127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:51Z,description=,direction='egress',ethertype='IPv6',id=f6ebe356-0e11-42e4-b64e-602ce3d8d3ca,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aba854709eb547f9b7998ff458a00168',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=72f2229f-a819-43f0-8eb9-f395d1783e5e,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:52.107127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f6ebe356-0e11-42e4-b64e-602ce3d8d3ca), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.107127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Security group rule updated ['72f2229f-a819-43f0-8eb9-f395d1783e5e'] Sep 30 09:47:52.107400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:51Z,description=,direction='ingress',ethertype='IPv4',id=f6f841ff-b0c8-4b69-825b-9317b617530a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='aba854709eb547f9b7998ff458a00168',protocol=,remote_address_group_id=,remote_group_id=72f2229f-a819-43f0-8eb9-f395d1783e5e,remote_ip_prefix=,revision_number=0,security_group_id=72f2229f-a819-43f0-8eb9-f395d1783e5e,updated_at=2022-09-30T09:47:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:52.107400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f6f841ff-b0c8-4b69-825b-9317b617530a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.107623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e4b2f4ce-82b6-4918-9747-c7500f00e7d5 admin admin] Security group rule updated ['72f2229f-a819-43f0-8eb9-f395d1783e5e'] Sep 30 09:47:52.287192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:309 started Sep 30 09:47:52.289600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c03fe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=789000000,duration_sec=630,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:52.290190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:52.290549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:309 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:52.352294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Resource SecurityGroup deleted: 72f2229f-a819-43f0-8eb9-f395d1783e5e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:52.352913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (72f2229f-a819-43f0-8eb9-f395d1783e5e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.353189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('72f2229f-a819-43f0-8eb9-f395d1783e5e',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:52.366193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('72f2229f-a819-43f0-8eb9-f395d1783e5e',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:52.367057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Resource SecurityGroupRule deleted: 2ece4446-2547-43e2-935a-5bfb87b03999 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:52.367688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2ece4446-2547-43e2-935a-5bfb87b03999), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.368172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Security group rule updated ['72f2229f-a819-43f0-8eb9-f395d1783e5e'] Sep 30 09:47:52.369327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Resource SecurityGroupRule deleted: 8f1284de-7884-4f92-83f8-e29bbd43e0ad {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:52.369820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8f1284de-7884-4f92-83f8-e29bbd43e0ad), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.370284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Security group rule updated ['72f2229f-a819-43f0-8eb9-f395d1783e5e'] Sep 30 09:47:52.370818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Resource SecurityGroupRule deleted: f6ebe356-0e11-42e4-b64e-602ce3d8d3ca {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:52.371433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f6ebe356-0e11-42e4-b64e-602ce3d8d3ca), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.371907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Security group rule updated ['72f2229f-a819-43f0-8eb9-f395d1783e5e'] Sep 30 09:47:52.372710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Resource SecurityGroupRule deleted: f6f841ff-b0c8-4b69-825b-9317b617530a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:52.373101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f6f841ff-b0c8-4b69-825b-9317b617530a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.373556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2fa7505c-7ce2-4ae9-bd54-d7d6d7a5e330 admin admin] Security group rule updated ['72f2229f-a819-43f0-8eb9-f395d1783e5e'] Sep 30 09:47:52.859079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:52Z,description='Default security group',id=35fe4fab-f7e7-497f-b77d-71379dee8053,is_default=True,name='default',project_id='c1eb9ddbc0a84a308ceffeae5198f229',revision_number=1,rules=[SecurityGroupRule(139e43c8-4a86-49da-bd57-7f5b6ed286fc),SecurityGroupRule(294e2812-1d8b-4a33-9f4a-bb77f211ba0a),SecurityGroupRule(547b961c-5084-4509-9aad-77e63de2ce22),SecurityGroupRule(9d96663b-d5bc-4e2e-a441-0b58b953c7e8)],shared=False,stateful=True,updated_at=2022-09-30T09:47:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:52.859785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (35fe4fab-f7e7-497f-b77d-71379dee8053), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.862449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:52Z,description=,direction='ingress',ethertype='IPv6',id=139e43c8-4a86-49da-bd57-7f5b6ed286fc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c1eb9ddbc0a84a308ceffeae5198f229',protocol=,remote_address_group_id=,remote_group_id=35fe4fab-f7e7-497f-b77d-71379dee8053,remote_ip_prefix=,revision_number=0,security_group_id=35fe4fab-f7e7-497f-b77d-71379dee8053,updated_at=2022-09-30T09:47:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:52.863067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (139e43c8-4a86-49da-bd57-7f5b6ed286fc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.863586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Security group rule updated ['35fe4fab-f7e7-497f-b77d-71379dee8053'] Sep 30 09:47:52.869017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:52Z,description=,direction='ingress',ethertype='IPv4',id=294e2812-1d8b-4a33-9f4a-bb77f211ba0a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c1eb9ddbc0a84a308ceffeae5198f229',protocol=,remote_address_group_id=,remote_group_id=35fe4fab-f7e7-497f-b77d-71379dee8053,remote_ip_prefix=,revision_number=0,security_group_id=35fe4fab-f7e7-497f-b77d-71379dee8053,updated_at=2022-09-30T09:47:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:52.869017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (294e2812-1d8b-4a33-9f4a-bb77f211ba0a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.869017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Security group rule updated ['35fe4fab-f7e7-497f-b77d-71379dee8053'] Sep 30 09:47:52.869306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:52Z,description=,direction='egress',ethertype='IPv4',id=547b961c-5084-4509-9aad-77e63de2ce22,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c1eb9ddbc0a84a308ceffeae5198f229',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=35fe4fab-f7e7-497f-b77d-71379dee8053,updated_at=2022-09-30T09:47:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:52.869306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (547b961c-5084-4509-9aad-77e63de2ce22), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.869306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Security group rule updated ['35fe4fab-f7e7-497f-b77d-71379dee8053'] Sep 30 09:47:52.869552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:52Z,description=,direction='egress',ethertype='IPv6',id=9d96663b-d5bc-4e2e-a441-0b58b953c7e8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='c1eb9ddbc0a84a308ceffeae5198f229',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=35fe4fab-f7e7-497f-b77d-71379dee8053,updated_at=2022-09-30T09:47:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:52.869694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (9d96663b-d5bc-4e2e-a441-0b58b953c7e8), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:52.870178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Security group rule updated ['35fe4fab-f7e7-497f-b77d-71379dee8053'] Sep 30 09:47:53.067199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:47:52Z,description='',dns_domain=None,id=19f705b3-87b0-406c-8a82-287369b1f01f,mtu=1500,name='tempest-VolumesActionsTest-520939206-network',project_id='c1eb9ddbc0a84a308ceffeae5198f229',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(19f705b3-87b0-406c-8a82-287369b1f01f),segments=[NetworkSegment(11f0f416-ce09-4705-9d84-2507bb4fe522)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:47:52Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:53.067662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (19f705b3-87b0-406c-8a82-287369b1f01f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:53.142924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-8c8bca5f-f444-4e32-9315-5cf67c1d64bc admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 19f705b3-87b0-406c-8a82-287369b1f01f with segmentation id not found. Sep 30 09:47:53.142924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:47:53.142924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:47:53.142924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:47:53.142924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:47:53.142924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:47:53.142924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:47:53.142924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:47:53.142924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:47:53.142924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:47:53.142924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:47:53.142924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:47:53.142924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:47:53.144006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:47:53.144006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:47:53.144006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:47:53.144006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 19f705b3-87b0-406c-8a82-287369b1f01f with segmentation id not found. Sep 30 09:47:53.144006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:47:53.583547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f967c66b-4c27-4131-a293-e272c2bfb84d admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(baf4ad10-a4e2-491d-9c5a-3d29d87460a1)],cidr=172.20.0.0/28,created_at=2022-09-30T09:47:53Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=cc6f8afb-b389-431a-9b53-54a02cc2cc80,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-520939206-subnet',network_id=19f705b3-87b0-406c-8a82-287369b1f01f,project_id='c1eb9ddbc0a84a308ceffeae5198f229',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:47:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:53.584133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f967c66b-4c27-4131-a293-e272c2bfb84d admin admin] Publish callbacks [] for Subnet (cc6f8afb-b389-431a-9b53-54a02cc2cc80), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:54.296085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:310 started Sep 30 09:47:54.296085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0400,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=791000000,duration_sec=632,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:54.296085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:54.296085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:310 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:54.503932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:54Z,description='Default security group',id=ce88d234-5393-4d04-84a8-b4ed1ded544a,is_default=True,name='default',project_id='fa7a5810c8f840f699ba8281407f4a81',revision_number=1,rules=[SecurityGroupRule(50a8ca4d-8548-4c99-9d53-a69c9f77b284),SecurityGroupRule(7f525f10-0800-4a4b-8c80-283f59877aa9),SecurityGroupRule(871065c1-61e3-4dfe-8a9f-a997283feb2f),SecurityGroupRule(899e3a57-b363-4866-9ea7-726db40e0866)],shared=False,stateful=True,updated_at=2022-09-30T09:47:54Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:54.504530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (ce88d234-5393-4d04-84a8-b4ed1ded544a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:54.505306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:54Z,description=,direction='ingress',ethertype='IPv4',id=50a8ca4d-8548-4c99-9d53-a69c9f77b284,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fa7a5810c8f840f699ba8281407f4a81',protocol=,remote_address_group_id=,remote_group_id=ce88d234-5393-4d04-84a8-b4ed1ded544a,remote_ip_prefix=,revision_number=0,security_group_id=ce88d234-5393-4d04-84a8-b4ed1ded544a,updated_at=2022-09-30T09:47:54Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:54.521260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (50a8ca4d-8548-4c99-9d53-a69c9f77b284), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:54.521260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Security group rule updated ['ce88d234-5393-4d04-84a8-b4ed1ded544a'] Sep 30 09:47:54.521260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:54Z,description=,direction='egress',ethertype='IPv4',id=7f525f10-0800-4a4b-8c80-283f59877aa9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fa7a5810c8f840f699ba8281407f4a81',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ce88d234-5393-4d04-84a8-b4ed1ded544a,updated_at=2022-09-30T09:47:54Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:54.521260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7f525f10-0800-4a4b-8c80-283f59877aa9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:54.521764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Security group rule updated ['ce88d234-5393-4d04-84a8-b4ed1ded544a'] Sep 30 09:47:54.521764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:54Z,description=,direction='ingress',ethertype='IPv6',id=871065c1-61e3-4dfe-8a9f-a997283feb2f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fa7a5810c8f840f699ba8281407f4a81',protocol=,remote_address_group_id=,remote_group_id=ce88d234-5393-4d04-84a8-b4ed1ded544a,remote_ip_prefix=,revision_number=0,security_group_id=ce88d234-5393-4d04-84a8-b4ed1ded544a,updated_at=2022-09-30T09:47:54Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:54.521764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (871065c1-61e3-4dfe-8a9f-a997283feb2f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:54.521764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Security group rule updated ['ce88d234-5393-4d04-84a8-b4ed1ded544a'] Sep 30 09:47:54.522062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:54Z,description=,direction='egress',ethertype='IPv6',id=899e3a57-b363-4866-9ea7-726db40e0866,normalized_cidr=None,port_range_max=,port_range_min=,project_id='fa7a5810c8f840f699ba8281407f4a81',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ce88d234-5393-4d04-84a8-b4ed1ded544a,updated_at=2022-09-30T09:47:54Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:54.522062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (899e3a57-b363-4866-9ea7-726db40e0866), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:54.522062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dbabd2ca-fead-4f7e-ad84-89890ff77567 admin admin] Security group rule updated ['ce88d234-5393-4d04-84a8-b4ed1ded544a'] Sep 30 09:47:54.758160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Resource SecurityGroup deleted: ce88d234-5393-4d04-84a8-b4ed1ded544a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:54.758824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (ce88d234-5393-4d04-84a8-b4ed1ded544a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:54.759021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ce88d234-5393-4d04-84a8-b4ed1ded544a',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:54.774746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ce88d234-5393-4d04-84a8-b4ed1ded544a',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:54.775141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Resource SecurityGroupRule deleted: 50a8ca4d-8548-4c99-9d53-a69c9f77b284 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:54.775648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (50a8ca4d-8548-4c99-9d53-a69c9f77b284), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:54.775989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Security group rule updated ['ce88d234-5393-4d04-84a8-b4ed1ded544a'] Sep 30 09:47:54.776377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Resource SecurityGroupRule deleted: 7f525f10-0800-4a4b-8c80-283f59877aa9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:54.776729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7f525f10-0800-4a4b-8c80-283f59877aa9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:54.777047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Security group rule updated ['ce88d234-5393-4d04-84a8-b4ed1ded544a'] Sep 30 09:47:54.777411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Resource SecurityGroupRule deleted: 871065c1-61e3-4dfe-8a9f-a997283feb2f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:54.777750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (871065c1-61e3-4dfe-8a9f-a997283feb2f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:54.778063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Security group rule updated ['ce88d234-5393-4d04-84a8-b4ed1ded544a'] Sep 30 09:47:54.778427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Resource SecurityGroupRule deleted: 899e3a57-b363-4866-9ea7-726db40e0866 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:54.778796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (899e3a57-b363-4866-9ea7-726db40e0866), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:54.779107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-99ce321f-6984-4349-b7f8-6c1defddd5f1 admin admin] Security group rule updated ['ce88d234-5393-4d04-84a8-b4ed1ded544a'] Sep 30 09:47:56.289715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:311 started Sep 30 09:47:56.292703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0402,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=792000000,duration_sec=634,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:56.293368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:56.293779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:311 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:56.381228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:56Z,description='Default security group',id=79b2b668-a3b5-43f3-a833-bdba21c7bb97,is_default=True,name='default',project_id='4714790785e448f7a397a06d0fd36eb2',revision_number=1,rules=[SecurityGroupRule(7235823a-780d-4812-9049-046ff1be5729),SecurityGroupRule(84705095-fa4d-4bbd-8c23-b43710c285f3),SecurityGroupRule(86a9b104-88d8-4871-b32a-7b751172f894),SecurityGroupRule(bd843369-7fac-415c-a9a8-69b7350dc74f)],shared=False,stateful=True,updated_at=2022-09-30T09:47:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:56.381679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (79b2b668-a3b5-43f3-a833-bdba21c7bb97), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.382383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:56Z,description=,direction='egress',ethertype='IPv4',id=7235823a-780d-4812-9049-046ff1be5729,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4714790785e448f7a397a06d0fd36eb2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=79b2b668-a3b5-43f3-a833-bdba21c7bb97,updated_at=2022-09-30T09:47:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:56.382966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7235823a-780d-4812-9049-046ff1be5729), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.383331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Security group rule updated ['79b2b668-a3b5-43f3-a833-bdba21c7bb97'] Sep 30 09:47:56.384078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:56Z,description=,direction='ingress',ethertype='IPv6',id=84705095-fa4d-4bbd-8c23-b43710c285f3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4714790785e448f7a397a06d0fd36eb2',protocol=,remote_address_group_id=,remote_group_id=79b2b668-a3b5-43f3-a833-bdba21c7bb97,remote_ip_prefix=,revision_number=0,security_group_id=79b2b668-a3b5-43f3-a833-bdba21c7bb97,updated_at=2022-09-30T09:47:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:56.384730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (84705095-fa4d-4bbd-8c23-b43710c285f3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.385535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Security group rule updated ['79b2b668-a3b5-43f3-a833-bdba21c7bb97'] Sep 30 09:47:56.386907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:56Z,description=,direction='ingress',ethertype='IPv4',id=86a9b104-88d8-4871-b32a-7b751172f894,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4714790785e448f7a397a06d0fd36eb2',protocol=,remote_address_group_id=,remote_group_id=79b2b668-a3b5-43f3-a833-bdba21c7bb97,remote_ip_prefix=,revision_number=0,security_group_id=79b2b668-a3b5-43f3-a833-bdba21c7bb97,updated_at=2022-09-30T09:47:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:56.387336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (86a9b104-88d8-4871-b32a-7b751172f894), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.387740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Security group rule updated ['79b2b668-a3b5-43f3-a833-bdba21c7bb97'] Sep 30 09:47:56.388473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:56Z,description=,direction='egress',ethertype='IPv6',id=bd843369-7fac-415c-a9a8-69b7350dc74f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4714790785e448f7a397a06d0fd36eb2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=79b2b668-a3b5-43f3-a833-bdba21c7bb97,updated_at=2022-09-30T09:47:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:56.388917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (bd843369-7fac-415c-a9a8-69b7350dc74f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.389474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-226e447e-b075-4b5f-bc01-d6c5ce5e5c91 admin admin] Security group rule updated ['79b2b668-a3b5-43f3-a833-bdba21c7bb97'] Sep 30 09:47:56.484511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:56Z,description='Default security group',id=486454ec-5304-4b26-ac0e-18fa2421327c,is_default=True,name='default',project_id='0be64f8f1d4b452e84a7bcd64f6100d1',revision_number=1,rules=[SecurityGroupRule(692c465d-3cc5-4dc6-a377-0b986627c4f1),SecurityGroupRule(7d02ee22-1856-41dc-8dbb-f894138080bc),SecurityGroupRule(abe2ad70-5ffd-402d-afa3-40c1855b04b8),SecurityGroupRule(b85de6ff-91af-4638-8711-8d760f93f72b)],shared=False,stateful=True,updated_at=2022-09-30T09:47:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:56.485329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (486454ec-5304-4b26-ac0e-18fa2421327c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.486473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:56Z,description=,direction='ingress',ethertype='IPv6',id=692c465d-3cc5-4dc6-a377-0b986627c4f1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',protocol=,remote_address_group_id=,remote_group_id=486454ec-5304-4b26-ac0e-18fa2421327c,remote_ip_prefix=,revision_number=0,security_group_id=486454ec-5304-4b26-ac0e-18fa2421327c,updated_at=2022-09-30T09:47:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:56.487025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (692c465d-3cc5-4dc6-a377-0b986627c4f1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.489026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Security group rule updated ['486454ec-5304-4b26-ac0e-18fa2421327c'] Sep 30 09:47:56.490635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:56Z,description=,direction='egress',ethertype='IPv4',id=7d02ee22-1856-41dc-8dbb-f894138080bc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=486454ec-5304-4b26-ac0e-18fa2421327c,updated_at=2022-09-30T09:47:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:56.492073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7d02ee22-1856-41dc-8dbb-f894138080bc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.492336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Security group rule updated ['486454ec-5304-4b26-ac0e-18fa2421327c'] Sep 30 09:47:56.494123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:56Z,description=,direction='ingress',ethertype='IPv4',id=abe2ad70-5ffd-402d-afa3-40c1855b04b8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',protocol=,remote_address_group_id=,remote_group_id=486454ec-5304-4b26-ac0e-18fa2421327c,remote_ip_prefix=,revision_number=0,security_group_id=486454ec-5304-4b26-ac0e-18fa2421327c,updated_at=2022-09-30T09:47:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:56.501647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (abe2ad70-5ffd-402d-afa3-40c1855b04b8), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.502021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Security group rule updated ['486454ec-5304-4b26-ac0e-18fa2421327c'] Sep 30 09:47:56.502782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:56Z,description=,direction='egress',ethertype='IPv6',id=b85de6ff-91af-4638-8711-8d760f93f72b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=486454ec-5304-4b26-ac0e-18fa2421327c,updated_at=2022-09-30T09:47:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:56.503153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b85de6ff-91af-4638-8711-8d760f93f72b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.503499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Security group rule updated ['486454ec-5304-4b26-ac0e-18fa2421327c'] Sep 30 09:47:56.644008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Resource SecurityGroup deleted: 79b2b668-a3b5-43f3-a833-bdba21c7bb97 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:56.644390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (79b2b668-a3b5-43f3-a833-bdba21c7bb97), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.644876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('79b2b668-a3b5-43f3-a833-bdba21c7bb97',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:56.680629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('79b2b668-a3b5-43f3-a833-bdba21c7bb97',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:56.681089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Resource SecurityGroupRule deleted: 7235823a-780d-4812-9049-046ff1be5729 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:56.681452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7235823a-780d-4812-9049-046ff1be5729), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.681876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Security group rule updated ['79b2b668-a3b5-43f3-a833-bdba21c7bb97'] Sep 30 09:47:56.682158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Resource SecurityGroupRule deleted: 84705095-fa4d-4bbd-8c23-b43710c285f3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:56.682517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (84705095-fa4d-4bbd-8c23-b43710c285f3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.682862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Security group rule updated ['79b2b668-a3b5-43f3-a833-bdba21c7bb97'] Sep 30 09:47:56.683232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Resource SecurityGroupRule deleted: 86a9b104-88d8-4871-b32a-7b751172f894 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:56.688156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (86a9b104-88d8-4871-b32a-7b751172f894), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.691450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Security group rule updated ['79b2b668-a3b5-43f3-a833-bdba21c7bb97'] Sep 30 09:47:56.692029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Resource SecurityGroupRule deleted: bd843369-7fac-415c-a9a8-69b7350dc74f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:56.693195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (bd843369-7fac-415c-a9a8-69b7350dc74f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.693716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-432e00d6-413b-4132-a113-51a4cb43d4aa admin admin] Security group rule updated ['79b2b668-a3b5-43f3-a833-bdba21c7bb97'] Sep 30 09:47:56.797328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:47:56Z,description='',dns_domain=None,id=5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7,mtu=1500,name='tempest-TestMinimumBasicScenario-505590960-network',project_id='0be64f8f1d4b452e84a7bcd64f6100d1',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7),segments=[NetworkSegment(9721804e-7351-4e77-b7b7-263929da43a3)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:47:56Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:56.808782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:56.868152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-8d7dd98a-f014-4006-bada-3b52c2233f31 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7 with segmentation id not found. Sep 30 09:47:56.868152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:47:56.868152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:47:56.868152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:47:56.868152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:47:56.868152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:47:56.868152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:47:56.868152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:47:56.868152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:47:56.868152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:47:56.868152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:47:56.868152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:47:56.868152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:47:56.869416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:47:56.869416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:47:56.869416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:47:56.869416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7 with segmentation id not found. Sep 30 09:47:56.869416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:47:57.344572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4ffddf01-af00-423d-a5d1-f57dd0959868 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(b80b0698-91bb-4818-903d-7ef441b1e4ca)],cidr=172.20.0.0/28,created_at=2022-09-30T09:47:57Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=509cb759-bc8e-41b1-b266-190b5b61d2ee,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-505590960-subnet',network_id=5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:47:57Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:57.345561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4ffddf01-af00-423d-a5d1-f57dd0959868 admin admin] Publish callbacks [] for Subnet (509cb759-bc8e-41b1-b266-190b5b61d2ee), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:58.291262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:312 started Sep 30 09:47:58.293994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0404,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=794000000,duration_sec=636,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:47:58.294581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:47:58.295445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:312 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:47:58.360848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6886762b-e133-43b5-bbed-568587d47d68 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:47:57Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=f2c8073f-d898-4b31-8e4f-86102bf18fab,mac_address=fa:16:3e:c3:58:a8,name='',network_id=5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7,numa_affinity_policy=,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(f2c8073f-d898-4b31-8e4f-86102bf18fab),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:47:58Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:58.361989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6886762b-e133-43b5-bbed-568587d47d68 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (f2c8073f-d898-4b31-8e4f-86102bf18fab), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:58.672979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6886762b-e133-43b5-bbed-568587d47d68 None None] Resource Port f2c8073f-d898-4b31-8e4f-86102bf18fab updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f2c8073f-d898-4b31-8e4f-86102bf18fab,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=f2c8073f-d898-4b31-8e4f-86102bf18fab,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=f2c8073f-d898-4b31-8e4f-86102bf18fab,segment=NetworkSegment(9721804e-7351-4e77-b7b7-263929da43a3),segment_id=9721804e-7351-4e77-b7b7-263929da43a3)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:47:58.673477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6886762b-e133-43b5-bbed-568587d47d68 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (f2c8073f-d898-4b31-8e4f-86102bf18fab), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:58.809755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f9763554-8d7c-461c-8267-dd1582ee2da9","insert","tapf2c8073f-d8",["set",[]],["map",[["attached-mac","fa:16:3e:c3:58:a8"],["iface-id","f2c8073f-d898-4b31-8e4f-86102bf18fab"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:47:58.823014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f9763554-8d7c-461c-8267-dd1582ee2da9","old",null,["set",[]],null],["","new","tapf2c8073f-d8",15,["map",[["attached-mac","fa:16:3e:c3:58:a8"],["iface-id","f2c8073f-d898-4b31-8e4f-86102bf18fab"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:47:59.041524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7f966476-531c-41e3-bedd-dd82bd681f5e admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:47:58Z,data_plane_status=None,description='',device_id='c81ae97f-4108-4176-a5ad-ddbb1d333c7b',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=d72d1c4d-bf3d-4bc6-884d-d0a700f1a025,mac_address=fa:16:3e:af:bf:d5,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(d72d1c4d-bf3d-4bc6-884d-d0a700f1a025),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:47:58Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:59.041904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7f966476-531c-41e3-bedd-dd82bd681f5e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (d72d1c4d-bf3d-4bc6-884d-d0a700f1a025), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:59.460857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:47:59Z,description='Default security group',id=8dfda197-d640-4d36-ab98-eb51d24dc114,is_default=True,name='default',project_id='828649edae4b4cbaa1176341d5d933b0',revision_number=1,rules=[SecurityGroupRule(4477d99a-020e-43bd-ab46-95ac652453d5),SecurityGroupRule(74e2050c-9dd3-4087-9a0e-426499738086),SecurityGroupRule(a5e48ffd-d15c-433a-95a0-d52a1d6f3de9),SecurityGroupRule(efb0ab21-524e-40b2-b3b1-04242f01edc7)],shared=False,stateful=True,updated_at=2022-09-30T09:47:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:59.460857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (8dfda197-d640-4d36-ab98-eb51d24dc114), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:59.460857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:59Z,description=,direction='ingress',ethertype='IPv6',id=4477d99a-020e-43bd-ab46-95ac652453d5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='828649edae4b4cbaa1176341d5d933b0',protocol=,remote_address_group_id=,remote_group_id=8dfda197-d640-4d36-ab98-eb51d24dc114,remote_ip_prefix=,revision_number=0,security_group_id=8dfda197-d640-4d36-ab98-eb51d24dc114,updated_at=2022-09-30T09:47:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:59.461596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4477d99a-020e-43bd-ab46-95ac652453d5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:59.461596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Security group rule updated ['8dfda197-d640-4d36-ab98-eb51d24dc114'] Sep 30 09:47:59.461596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:59Z,description=,direction='egress',ethertype='IPv6',id=74e2050c-9dd3-4087-9a0e-426499738086,normalized_cidr=None,port_range_max=,port_range_min=,project_id='828649edae4b4cbaa1176341d5d933b0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8dfda197-d640-4d36-ab98-eb51d24dc114,updated_at=2022-09-30T09:47:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:59.461596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (74e2050c-9dd3-4087-9a0e-426499738086), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:59.461999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Security group rule updated ['8dfda197-d640-4d36-ab98-eb51d24dc114'] Sep 30 09:47:59.461999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:59Z,description=,direction='ingress',ethertype='IPv4',id=a5e48ffd-d15c-433a-95a0-d52a1d6f3de9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='828649edae4b4cbaa1176341d5d933b0',protocol=,remote_address_group_id=,remote_group_id=8dfda197-d640-4d36-ab98-eb51d24dc114,remote_ip_prefix=,revision_number=0,security_group_id=8dfda197-d640-4d36-ab98-eb51d24dc114,updated_at=2022-09-30T09:47:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:59.461999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a5e48ffd-d15c-433a-95a0-d52a1d6f3de9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:59.461999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Security group rule updated ['8dfda197-d640-4d36-ab98-eb51d24dc114'] Sep 30 09:47:59.462295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:47:59Z,description=,direction='egress',ethertype='IPv4',id=efb0ab21-524e-40b2-b3b1-04242f01edc7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='828649edae4b4cbaa1176341d5d933b0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8dfda197-d640-4d36-ab98-eb51d24dc114,updated_at=2022-09-30T09:47:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:47:59.462295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (efb0ab21-524e-40b2-b3b1-04242f01edc7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:59.462295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cc810c09-d4e4-448d-8a56-38b6104b2da0 admin admin] Security group rule updated ['8dfda197-d640-4d36-ab98-eb51d24dc114'] Sep 30 09:47:59.743458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Resource SecurityGroup deleted: 8dfda197-d640-4d36-ab98-eb51d24dc114 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:59.744047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (8dfda197-d640-4d36-ab98-eb51d24dc114), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:59.744662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8dfda197-d640-4d36-ab98-eb51d24dc114',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:47:59.819067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8dfda197-d640-4d36-ab98-eb51d24dc114',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:47:59.820237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Resource SecurityGroupRule deleted: 4477d99a-020e-43bd-ab46-95ac652453d5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:59.820712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4477d99a-020e-43bd-ab46-95ac652453d5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:59.821295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Security group rule updated ['8dfda197-d640-4d36-ab98-eb51d24dc114'] Sep 30 09:47:59.822003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Resource SecurityGroupRule deleted: 74e2050c-9dd3-4087-9a0e-426499738086 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:59.822511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (74e2050c-9dd3-4087-9a0e-426499738086), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:59.823011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Security group rule updated ['8dfda197-d640-4d36-ab98-eb51d24dc114'] Sep 30 09:47:59.827127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Resource SecurityGroupRule deleted: a5e48ffd-d15c-433a-95a0-d52a1d6f3de9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:59.827127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a5e48ffd-d15c-433a-95a0-d52a1d6f3de9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:59.827127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Security group rule updated ['8dfda197-d640-4d36-ab98-eb51d24dc114'] Sep 30 09:47:59.827127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Resource SecurityGroupRule deleted: efb0ab21-524e-40b2-b3b1-04242f01edc7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:47:59.827127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (efb0ab21-524e-40b2-b3b1-04242f01edc7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:47:59.827744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-796a2df8-8a96-421f-a695-4a2180484d53 admin admin] Security group rule updated ['8dfda197-d640-4d36-ab98-eb51d24dc114'] Sep 30 09:48:00.094100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-040a8853-71b9-4c7d-8484-9ec491b7446f None None] Resource Port f2c8073f-d898-4b31-8e4f-86102bf18fab updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:00.094727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-040a8853-71b9-4c7d-8484-9ec491b7446f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (f2c8073f-d898-4b31-8e4f-86102bf18fab), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:00.292005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:313 started Sep 30 09:48:00.297679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0406,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=794000000,duration_sec=638,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:00.298397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:00.298909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:313 - starting polling. Elapsed:0.007 Sep 30 09:48:00.300760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:00.303099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:313 - port information retrieved. Elapsed:0.011 Sep 30 09:48:00.303422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': {'f2c8073f-d898-4b31-8e4f-86102bf18fab'}, 'removed': set(), 'updated': {'f2c8073f-d898-4b31-8e4f-86102bf18fab'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:00.303973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'f2c8073f-d898-4b31-8e4f-86102bf18fab', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7', 'network_id': '5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7', 'port_id': 'f2c8073f-d898-4b31-8e4f-86102bf18fab', 'mac_address': 'fa:16:3e:c3:58:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 358, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '509cb759-bc8e-41b1-b266-190b5b61d2ee', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:00.306183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: f2c8073f-d898-4b31-8e4f-86102bf18fab {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:00.306649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port f2c8073f-d898-4b31-8e4f-86102bf18fab updated. Details: {'device': 'f2c8073f-d898-4b31-8e4f-86102bf18fab', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7', 'network_id': '5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7', 'port_id': 'f2c8073f-d898-4b31-8e4f-86102bf18fab', 'mac_address': 'fa:16:3e:c3:58:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 358, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '509cb759-bc8e-41b1-b266-190b5b61d2ee', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:48:00.307199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 7 as local vlan for net-id=5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7, seg-id=358 Sep 30 09:48:00.310047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xc9105ef2,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4454), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:00.313075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xf1c0408,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4103)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4454}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:00.314033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapf2c8073f-d8, col_values=(('tag', 7),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:00.314456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapf2c8073f-d8, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:00.314919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapf2c8073f-d8, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:00.322632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapf2c8073f-d8, col_values=(('other_config', {'net_uuid': '5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '358'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:00.328879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c040a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:00.329270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:313 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 11 devices currently available. Time elapsed: 0.025 Sep 30 09:48:00.329622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:48:00.329911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'f2c8073f-d898-4b31-8e4f-86102bf18fab'} Sep 30 09:48:00.331430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:00.331723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:00.334784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:00.389718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[82948c53-0067-49f0-937c-07db5d0c1a85]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:00.390640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:313 - agent port security group processed in 0.087 Sep 30 09:48:00.391370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for f2c8073f-d898-4b31-8e4f-86102bf18fab to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:00.802103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['f2c8073f-d898-4b31-8e4f-86102bf18fab'] and devices down [] completed. Sep 30 09:48:00.802103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:313 - ports processed. Elapsed:0.509 Sep 30 09:48:00.802103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:313 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.509 Sep 30 09:48:01.322862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-86a541ed-62d4-4332-8d4d-58786612b567 None None] Resource Port d72d1c4d-bf3d-4bc6-884d-d0a700f1a025 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=d72d1c4d-bf3d-4bc6-884d-d0a700f1a025,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d72d1c4d-bf3d-4bc6-884d-d0a700f1a025,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:01.324021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-86a541ed-62d4-4332-8d4d-58786612b567 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (d72d1c4d-bf3d-4bc6-884d-d0a700f1a025), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:01.504151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5ec6741c-096a-4c1b-a5dc-cd0d7879f3ee admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:00Z,data_plane_status=None,description='',device_id='c81ae97f-4108-4176-a5ad-ddbb1d333c7b',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0e2e4418-df17-4fc2-8cfc-e77a0c696b6c,mac_address=fa:16:3e:40:d6:92,name='',network_id=5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7,numa_affinity_policy=,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0e2e4418-df17-4fc2-8cfc-e77a0c696b6c),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:48:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:01.504354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5ec6741c-096a-4c1b-a5dc-cd0d7879f3ee admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0e2e4418-df17-4fc2-8cfc-e77a0c696b6c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:01.606856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-86a541ed-62d4-4332-8d4d-58786612b567 None None] Resource Port d72d1c4d-bf3d-4bc6-884d-d0a700f1a025 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d72d1c4d-bf3d-4bc6-884d-d0a700f1a025,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=d72d1c4d-bf3d-4bc6-884d-d0a700f1a025,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d72d1c4d-bf3d-4bc6-884d-d0a700f1a025,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:01.608073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-86a541ed-62d4-4332-8d4d-58786612b567 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (d72d1c4d-bf3d-4bc6-884d-d0a700f1a025), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:02.277697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4cc8a185-a35f-4186-9da1-0f02166d91c4","insert","qg-d72d1c4d-bf",["set",[]],["map",[["attached-mac","fa:16:3e:af:bf:d5"],["iface-id","d72d1c4d-bf3d-4bc6-884d-d0a700f1a025"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:02.290220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4cc8a185-a35f-4186-9da1-0f02166d91c4","old",null,["set",[]],null],["","new","qg-d72d1c4d-bf",16,["map",[["attached-mac","fa:16:3e:af:bf:d5"],["iface-id","d72d1c4d-bf3d-4bc6-884d-d0a700f1a025"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:02.293863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:314 started Sep 30 09:48:02.305987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c040c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=800000000,duration_sec=640,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:02.308871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:02.309630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:314 - starting polling. Elapsed:0.016 Sep 30 09:48:02.314415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:02.317662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:314 - port information retrieved. Elapsed:0.024 Sep 30 09:48:02.318107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': {'d72d1c4d-bf3d-4bc6-884d-d0a700f1a025'}, 'removed': set(), 'updated': {'d72d1c4d-bf3d-4bc6-884d-d0a700f1a025'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:02.318713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', 'device_id': 'c81ae97f-4108-4176-a5ad-ddbb1d333c7b', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', 'mac_address': 'fa:16:3e:af:bf:d5', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.151'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:02.321229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: d72d1c4d-bf3d-4bc6-884d-d0a700f1a025 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:02.321770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port d72d1c4d-bf3d-4bc6-884d-d0a700f1a025 updated. Details: {'device': 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', 'device_id': 'c81ae97f-4108-4176-a5ad-ddbb1d333c7b', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', 'mac_address': 'fa:16:3e:af:bf:d5', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.151'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:48:02.323088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d72d1c4d-bf, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:02.327402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-d72d1c4d-bf, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:02.327402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-d72d1c4d-bf, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:02.328845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d72d1c4d-bf, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:02.361550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c040e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:02.362138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:314 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 12 devices currently available. Time elapsed: 0.043 Sep 30 09:48:02.362495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:48:02.362969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'d72d1c4d-bf3d-4bc6-884d-d0a700f1a025'} Sep 30 09:48:02.364146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:02.364423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:02.368428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:02.441362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb21d167-b868-4ead-af8f-a6704ff0e588]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:02.444278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:314 - agent port security group processed in 0.124 Sep 30 09:48:02.445411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for d72d1c4d-bf3d-4bc6-884d-d0a700f1a025 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:02.789721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5ec6741c-096a-4c1b-a5dc-cd0d7879f3ee admin admin] Received resource Port update without any changes: 0e2e4418-df17-4fc2-8cfc-e77a0c696b6c {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 30 09:48:02.813884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['d72d1c4d-bf3d-4bc6-884d-d0a700f1a025'] and devices down [] completed. Sep 30 09:48:02.815923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:314 - ports processed. Elapsed:0.522 Sep 30 09:48:02.816564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:314 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.523 Sep 30 09:48:02.927033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port d72d1c4d-bf3d-4bc6-884d-d0a700f1a025 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d72d1c4d-bf3d-4bc6-884d-d0a700f1a025,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=d72d1c4d-bf3d-4bc6-884d-d0a700f1a025,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:02.928017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (d72d1c4d-bf3d-4bc6-884d-d0a700f1a025), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.295707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:315 started Sep 30 09:48:04.299280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0410,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=799000000,duration_sec=642,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:04.299993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:04.300325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:315 - starting polling. Elapsed:0.005 Sep 30 09:48:04.302254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.304934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:315 - port information retrieved. Elapsed:0.009 Sep 30 09:48:04.305373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': set(), 'removed': set(), 'updated': {'d72d1c4d-bf3d-4bc6-884d-d0a700f1a025'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:04.305956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', 'device_id': 'c81ae97f-4108-4176-a5ad-ddbb1d333c7b', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', 'mac_address': 'fa:16:3e:af:bf:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.151'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:04.308287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: d72d1c4d-bf3d-4bc6-884d-d0a700f1a025 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:04.308595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port d72d1c4d-bf3d-4bc6-884d-d0a700f1a025 updated. Details: {'device': 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', 'device_id': 'c81ae97f-4108-4176-a5ad-ddbb1d333c7b', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', 'mac_address': 'fa:16:3e:af:bf:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.151'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:48:04.309967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d72d1c4d-bf, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:04.311100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-d72d1c4d-bf, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:04.311678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-d72d1c4d-bf, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:04.312123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:04.316236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-d72d1c4d-bf, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:04.316236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:04.316658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0412,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:04.316997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:315 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 12 devices currently available. Time elapsed: 0.011 Sep 30 09:48:04.317348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:48:04.317635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:48:04.318784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:04.319216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:04.324505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:04.379068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5276bd-b716-40d5-a262-4a5e2ca13b0e]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:04.380058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:315 - agent port security group processed in 0.074 Sep 30 09:48:04.381030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for d72d1c4d-bf3d-4bc6-884d-d0a700f1a025 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:04.429254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:04Z,description='Default security group',id=9cc7f8a8-de97-4711-a8c3-fa8a6927227c,is_default=True,name='default',project_id='ae05d51a1efc4c5398e9fa4ffeb7faa0',revision_number=1,rules=[SecurityGroupRule(2ed4c684-3c7b-463a-b1cb-2e1f0183d0fd),SecurityGroupRule(379497d9-cf69-4a48-b9f6-7a67bddbe7b8),SecurityGroupRule(4fd468ef-55f4-4c7f-a137-be898c10a846),SecurityGroupRule(e8615b25-13ad-47c4-a597-4d2ef46ca1e6)],shared=False,stateful=True,updated_at=2022-09-30T09:48:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:04.430028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (9cc7f8a8-de97-4711-a8c3-fa8a6927227c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.431059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:04Z,description=,direction='ingress',ethertype='IPv6',id=2ed4c684-3c7b-463a-b1cb-2e1f0183d0fd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ae05d51a1efc4c5398e9fa4ffeb7faa0',protocol=,remote_address_group_id=,remote_group_id=9cc7f8a8-de97-4711-a8c3-fa8a6927227c,remote_ip_prefix=,revision_number=0,security_group_id=9cc7f8a8-de97-4711-a8c3-fa8a6927227c,updated_at=2022-09-30T09:48:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:04.431891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2ed4c684-3c7b-463a-b1cb-2e1f0183d0fd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.432450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Security group rule updated ['9cc7f8a8-de97-4711-a8c3-fa8a6927227c'] Sep 30 09:48:04.433611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:04Z,description=,direction='ingress',ethertype='IPv4',id=379497d9-cf69-4a48-b9f6-7a67bddbe7b8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ae05d51a1efc4c5398e9fa4ffeb7faa0',protocol=,remote_address_group_id=,remote_group_id=9cc7f8a8-de97-4711-a8c3-fa8a6927227c,remote_ip_prefix=,revision_number=0,security_group_id=9cc7f8a8-de97-4711-a8c3-fa8a6927227c,updated_at=2022-09-30T09:48:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:04.434152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (379497d9-cf69-4a48-b9f6-7a67bddbe7b8), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.434742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Security group rule updated ['9cc7f8a8-de97-4711-a8c3-fa8a6927227c'] Sep 30 09:48:04.438466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:04Z,description=,direction='egress',ethertype='IPv6',id=4fd468ef-55f4-4c7f-a137-be898c10a846,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ae05d51a1efc4c5398e9fa4ffeb7faa0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9cc7f8a8-de97-4711-a8c3-fa8a6927227c,updated_at=2022-09-30T09:48:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:04.439109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4fd468ef-55f4-4c7f-a137-be898c10a846), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.439901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Security group rule updated ['9cc7f8a8-de97-4711-a8c3-fa8a6927227c'] Sep 30 09:48:04.442269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:04Z,description=,direction='egress',ethertype='IPv4',id=e8615b25-13ad-47c4-a597-4d2ef46ca1e6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ae05d51a1efc4c5398e9fa4ffeb7faa0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=9cc7f8a8-de97-4711-a8c3-fa8a6927227c,updated_at=2022-09-30T09:48:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:04.442730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e8615b25-13ad-47c4-a597-4d2ef46ca1e6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.443559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Security group rule updated ['9cc7f8a8-de97-4711-a8c3-fa8a6927227c'] Sep 30 09:48:04.569008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['d72d1c4d-bf3d-4bc6-884d-d0a700f1a025'] and devices down [] completed. Sep 30 09:48:04.569324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:315 - ports processed. Elapsed:0.274 Sep 30 09:48:04.569772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:315 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.274 Sep 30 09:48:04.633852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:04Z,description='Default security group',id=143e19d3-69b3-49f9-aac1-4e85d90103c2,is_default=True,name='default',project_id='b9df2c8224e94ba994c3971cf81dca4e',revision_number=1,rules=[SecurityGroupRule(0be6139d-086b-40fd-a973-2ca6622df6fe),SecurityGroupRule(5317e8fb-cc35-40bf-88f9-d0cae90586bd),SecurityGroupRule(c0100ea8-19ad-480d-8d84-97d44116f8cb),SecurityGroupRule(ccffc09c-32be-4dd9-b564-bed075d04a4e)],shared=False,stateful=True,updated_at=2022-09-30T09:48:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:04.634385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (143e19d3-69b3-49f9-aac1-4e85d90103c2), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.635611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:04Z,description=,direction='egress',ethertype='IPv4',id=0be6139d-086b-40fd-a973-2ca6622df6fe,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b9df2c8224e94ba994c3971cf81dca4e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=143e19d3-69b3-49f9-aac1-4e85d90103c2,updated_at=2022-09-30T09:48:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:04.636188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (0be6139d-086b-40fd-a973-2ca6622df6fe), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.636738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Security group rule updated ['143e19d3-69b3-49f9-aac1-4e85d90103c2'] Sep 30 09:48:04.637665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:04Z,description=,direction='ingress',ethertype='IPv4',id=5317e8fb-cc35-40bf-88f9-d0cae90586bd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b9df2c8224e94ba994c3971cf81dca4e',protocol=,remote_address_group_id=,remote_group_id=143e19d3-69b3-49f9-aac1-4e85d90103c2,remote_ip_prefix=,revision_number=0,security_group_id=143e19d3-69b3-49f9-aac1-4e85d90103c2,updated_at=2022-09-30T09:48:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:04.638659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5317e8fb-cc35-40bf-88f9-d0cae90586bd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.639057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Security group rule updated ['143e19d3-69b3-49f9-aac1-4e85d90103c2'] Sep 30 09:48:04.639919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:04Z,description=,direction='ingress',ethertype='IPv6',id=c0100ea8-19ad-480d-8d84-97d44116f8cb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b9df2c8224e94ba994c3971cf81dca4e',protocol=,remote_address_group_id=,remote_group_id=143e19d3-69b3-49f9-aac1-4e85d90103c2,remote_ip_prefix=,revision_number=0,security_group_id=143e19d3-69b3-49f9-aac1-4e85d90103c2,updated_at=2022-09-30T09:48:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:04.640427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c0100ea8-19ad-480d-8d84-97d44116f8cb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.640904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Security group rule updated ['143e19d3-69b3-49f9-aac1-4e85d90103c2'] Sep 30 09:48:04.642413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:04Z,description=,direction='egress',ethertype='IPv6',id=ccffc09c-32be-4dd9-b564-bed075d04a4e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b9df2c8224e94ba994c3971cf81dca4e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=143e19d3-69b3-49f9-aac1-4e85d90103c2,updated_at=2022-09-30T09:48:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:04.642996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (ccffc09c-32be-4dd9-b564-bed075d04a4e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.643521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f0db1fb5-c9f9-4750-af67-4ce7e3eb8657 admin admin] Security group rule updated ['143e19d3-69b3-49f9-aac1-4e85d90103c2'] Sep 30 09:48:04.675177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:48:04Z,description='',dns_domain=None,id=decc2ed9-0cd5-446c-93ae-1347454cf54d,mtu=1500,name='tempest-TestMinimumBasicScenario-246109580-network',project_id='ae05d51a1efc4c5398e9fa4ffeb7faa0',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(decc2ed9-0cd5-446c-93ae-1347454cf54d),segments=[NetworkSegment(a76f9122-53fd-4f0a-a917-5e14511f12a6)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:48:04Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:04.675815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (decc2ed9-0cd5-446c-93ae-1347454cf54d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.759849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-45ac3f8a-84de-497e-ad1b-df64a6d6859a None None] Resource Port 0e2e4418-df17-4fc2-8cfc-e77a0c696b6c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=0e2e4418-df17-4fc2-8cfc-e77a0c696b6c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0e2e4418-df17-4fc2-8cfc-e77a0c696b6c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:04.760709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-45ac3f8a-84de-497e-ad1b-df64a6d6859a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0e2e4418-df17-4fc2-8cfc-e77a0c696b6c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.764118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-25ad46a8-6ebd-4a20-856d-3134b18b11c6 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network decc2ed9-0cd5-446c-93ae-1347454cf54d with segmentation id not found. Sep 30 09:48:04.764118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:48:04.764118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:48:04.764118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:48:04.764118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:48:04.764118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:48:04.764118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:48:04.764118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:48:04.764118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:48:04.764118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:48:04.764118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:48:04.764118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:48:04.764118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:48:04.765001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:48:04.765001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:48:04.765001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:48:04.765001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network decc2ed9-0cd5-446c-93ae-1347454cf54d with segmentation id not found. Sep 30 09:48:04.765001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:48:04.907008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Resource SecurityGroup deleted: 143e19d3-69b3-49f9-aac1-4e85d90103c2 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:04.912354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (143e19d3-69b3-49f9-aac1-4e85d90103c2), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.912354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('143e19d3-69b3-49f9-aac1-4e85d90103c2',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:48:04.923354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('143e19d3-69b3-49f9-aac1-4e85d90103c2',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:48:04.923812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Resource SecurityGroupRule deleted: 0be6139d-086b-40fd-a973-2ca6622df6fe {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:04.924214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (0be6139d-086b-40fd-a973-2ca6622df6fe), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.924509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Security group rule updated ['143e19d3-69b3-49f9-aac1-4e85d90103c2'] Sep 30 09:48:04.925380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Resource SecurityGroupRule deleted: 5317e8fb-cc35-40bf-88f9-d0cae90586bd {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:04.925899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5317e8fb-cc35-40bf-88f9-d0cae90586bd), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.926368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Security group rule updated ['143e19d3-69b3-49f9-aac1-4e85d90103c2'] Sep 30 09:48:04.926912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Resource SecurityGroupRule deleted: c0100ea8-19ad-480d-8d84-97d44116f8cb {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:04.927956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c0100ea8-19ad-480d-8d84-97d44116f8cb), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.928450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Security group rule updated ['143e19d3-69b3-49f9-aac1-4e85d90103c2'] Sep 30 09:48:04.928969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Resource SecurityGroupRule deleted: ccffc09c-32be-4dd9-b564-bed075d04a4e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:04.929452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (ccffc09c-32be-4dd9-b564-bed075d04a4e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:04.930831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e65e5c27-58ed-447f-849e-0bef405c6d56 admin admin] Security group rule updated ['143e19d3-69b3-49f9-aac1-4e85d90103c2'] Sep 30 09:48:05.139234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-45ac3f8a-84de-497e-ad1b-df64a6d6859a None None] Resource Port 0e2e4418-df17-4fc2-8cfc-e77a0c696b6c updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0e2e4418-df17-4fc2-8cfc-e77a0c696b6c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=0e2e4418-df17-4fc2-8cfc-e77a0c696b6c,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=0e2e4418-df17-4fc2-8cfc-e77a0c696b6c,segment=NetworkSegment(9721804e-7351-4e77-b7b7-263929da43a3),segment_id=9721804e-7351-4e77-b7b7-263929da43a3)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:05.139802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-45ac3f8a-84de-497e-ad1b-df64a6d6859a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0e2e4418-df17-4fc2-8cfc-e77a0c696b6c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:05.275329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-82c084d7-b617-4e31-bafb-45e3e85ff1a8 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(0390e039-740d-44f5-8544-85c0e4558a79)],cidr=172.20.0.0/28,created_at=2022-09-30T09:48:04Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=1bc9d9ab-4fb8-4e97-9d6f-78f2c2201033,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestMinimumBasicScenario-246109580-subnet',network_id=decc2ed9-0cd5-446c-93ae-1347454cf54d,project_id='ae05d51a1efc4c5398e9fa4ffeb7faa0',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:48:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:05.275631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-82c084d7-b617-4e31-bafb-45e3e85ff1a8 admin admin] Publish callbacks [] for Subnet (1bc9d9ab-4fb8-4e97-9d6f-78f2c2201033), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:05.332407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4f3d7c6e-90a0-45a4-baa8-7e6767693f8a None None] Resource Port 0e2e4418-df17-4fc2-8cfc-e77a0c696b6c updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:05.332973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4f3d7c6e-90a0-45a4-baa8-7e6767693f8a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0e2e4418-df17-4fc2-8cfc-e77a0c696b6c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:05.542331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["249d03ba-159b-4ebb-8641-857c47e9e1d5","insert","qr-0e2e4418-df",["set",[]],["map",[["attached-mac","fa:16:3e:40:d6:92"],["iface-id","0e2e4418-df17-4fc2-8cfc-e77a0c696b6c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:05.574116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["249d03ba-159b-4ebb-8641-857c47e9e1d5","old",null,["set",[]],null],["","new","qr-0e2e4418-df",17,["map",[["attached-mac","fa:16:3e:40:d6:92"],["iface-id","0e2e4418-df17-4fc2-8cfc-e77a0c696b6c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:06.297058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:316 started Sep 30 09:48:06.299830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0414,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=799000000,duration_sec=644,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:06.300424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:06.300888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:316 - starting polling. Elapsed:0.004 Sep 30 09:48:06.302976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:06.305681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:316 - port information retrieved. Elapsed:0.009 Sep 30 09:48:06.306015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '0a907ef6-0733-4f96-9909-bd47d7e38800', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': {'0e2e4418-df17-4fc2-8cfc-e77a0c696b6c'}, 'removed': set(), 'updated': {'0e2e4418-df17-4fc2-8cfc-e77a0c696b6c'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:06.311007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'device_id': 'c81ae97f-4108-4176-a5ad-ddbb1d333c7b', 'network_id': '5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7', 'port_id': '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'mac_address': 'fa:16:3e:40:d6:92', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 358, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '509cb759-bc8e-41b1-b266-190b5b61d2ee', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:06.313616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 0e2e4418-df17-4fc2-8cfc-e77a0c696b6c {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:06.313940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 0e2e4418-df17-4fc2-8cfc-e77a0c696b6c updated. Details: {'device': '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'device_id': 'c81ae97f-4108-4176-a5ad-ddbb1d333c7b', 'network_id': '5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7', 'port_id': '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'mac_address': 'fa:16:3e:40:d6:92', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 358, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '509cb759-bc8e-41b1-b266-190b5b61d2ee', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 7} Sep 30 09:48:06.316355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-0e2e4418-df, col_values=(('tag', 7),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:06.323183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-0e2e4418-df, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:06.323624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-0e2e4418-df, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:06.336356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:05Z,description='Default security group',id=0a54fafc-30d1-4260-b1f1-5dd5a50faec0,is_default=True,name='default',project_id='ccfb4ade5d154d08a2df76f8b19cb8bf',revision_number=1,rules=[SecurityGroupRule(3796c389-8cfc-4b74-8495-00c7ddcbcef4),SecurityGroupRule(3f77caac-69cf-4b8a-b482-e51794e7cac7),SecurityGroupRule(8cab2396-31c3-4f71-bb7a-0d3527f567e4),SecurityGroupRule(e7e3221d-8bc6-43e4-8321-60e7d0006615)],shared=False,stateful=True,updated_at=2022-09-30T09:48:05Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:06.337027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (0a54fafc-30d1-4260-b1f1-5dd5a50faec0), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:06.337361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:05Z,description=,direction='ingress',ethertype='IPv6',id=3796c389-8cfc-4b74-8495-00c7ddcbcef4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ccfb4ade5d154d08a2df76f8b19cb8bf',protocol=,remote_address_group_id=,remote_group_id=0a54fafc-30d1-4260-b1f1-5dd5a50faec0,remote_ip_prefix=,revision_number=0,security_group_id=0a54fafc-30d1-4260-b1f1-5dd5a50faec0,updated_at=2022-09-30T09:48:05Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:06.337727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (3796c389-8cfc-4b74-8495-00c7ddcbcef4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:06.338093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Security group rule updated ['0a54fafc-30d1-4260-b1f1-5dd5a50faec0'] Sep 30 09:48:06.338772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:05Z,description=,direction='egress',ethertype='IPv4',id=3f77caac-69cf-4b8a-b482-e51794e7cac7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ccfb4ade5d154d08a2df76f8b19cb8bf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0a54fafc-30d1-4260-b1f1-5dd5a50faec0,updated_at=2022-09-30T09:48:05Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:06.339309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (3f77caac-69cf-4b8a-b482-e51794e7cac7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:06.339813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Security group rule updated ['0a54fafc-30d1-4260-b1f1-5dd5a50faec0'] Sep 30 09:48:06.340634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:05Z,description=,direction='ingress',ethertype='IPv4',id=8cab2396-31c3-4f71-bb7a-0d3527f567e4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ccfb4ade5d154d08a2df76f8b19cb8bf',protocol=,remote_address_group_id=,remote_group_id=0a54fafc-30d1-4260-b1f1-5dd5a50faec0,remote_ip_prefix=,revision_number=0,security_group_id=0a54fafc-30d1-4260-b1f1-5dd5a50faec0,updated_at=2022-09-30T09:48:05Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:06.341149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8cab2396-31c3-4f71-bb7a-0d3527f567e4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:06.342183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Security group rule updated ['0a54fafc-30d1-4260-b1f1-5dd5a50faec0'] Sep 30 09:48:06.343029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:05Z,description=,direction='egress',ethertype='IPv6',id=e7e3221d-8bc6-43e4-8321-60e7d0006615,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ccfb4ade5d154d08a2df76f8b19cb8bf',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0a54fafc-30d1-4260-b1f1-5dd5a50faec0,updated_at=2022-09-30T09:48:05Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:06.343564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e7e3221d-8bc6-43e4-8321-60e7d0006615), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:06.347605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7c36ee52-2ad9-4f40-a2a9-5b7a3453e7ca admin admin] Security group rule updated ['0a54fafc-30d1-4260-b1f1-5dd5a50faec0'] Sep 30 09:48:06.352080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-0e2e4418-df, col_values=(('other_config', {'net_uuid': '5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '7', 'segmentation_id': '358'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:06.359158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0416,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:06.359846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:316 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.054 Sep 30 09:48:06.360353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:48:06.360954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'0e2e4418-df17-4fc2-8cfc-e77a0c696b6c'} Sep 30 09:48:06.363083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:06.363517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:06.369210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:06.421939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc78cb0-2beb-4bd2-ad98-e2de9a828c7e]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:06.422987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:316 - agent port security group processed in 0.117 Sep 30 09:48:06.424263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 0e2e4418-df17-4fc2-8cfc-e77a0c696b6c to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:06.663009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-14ebe7f8-46cc-4c01-be88-c426834aa97c None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:05Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-decc2ed9-0cd5-446c-93ae-1347454cf54d',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=56cef7a4-f777-4bf3-94ed-8e22c13f3e1a,mac_address=fa:16:3e:0e:0c:b5,name='',network_id=decc2ed9-0cd5-446c-93ae-1347454cf54d,numa_affinity_policy=,project_id='ae05d51a1efc4c5398e9fa4ffeb7faa0',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(56cef7a4-f777-4bf3-94ed-8e22c13f3e1a),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:48:06Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:06.663400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-14ebe7f8-46cc-4c01-be88-c426834aa97c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (56cef7a4-f777-4bf3-94ed-8e22c13f3e1a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:06.829016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['0e2e4418-df17-4fc2-8cfc-e77a0c696b6c'] and devices down [] completed. Sep 30 09:48:06.829633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:316 - ports processed. Elapsed:0.533 Sep 30 09:48:06.830201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:316 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.533 Sep 30 09:48:07.022941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-be20d4f9-a808-4222-a48d-99989754f887 tempest-VolumesActionsTest-1876305362 tempest-VolumesActionsTest-1876305362-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:06Z,data_plane_status=None,description='',device_id='d9208352-ebfe-4580-abf1-4e55bb98a5a3',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=789f9272-6c06-496f-83bd-184cd3013e84,mac_address=fa:16:3e:ae:9d:0a,name='',network_id=19f705b3-87b0-406c-8a82-287369b1f01f,numa_affinity_policy=,project_id='c1eb9ddbc0a84a308ceffeae5198f229',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(789f9272-6c06-496f-83bd-184cd3013e84),security_group_ids=set([35fe4fab-f7e7-497f-b77d-71379dee8053]),status='DOWN',updated_at=2022-09-30T09:48:06Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:07.023416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-be20d4f9-a808-4222-a48d-99989754f887 tempest-VolumesActionsTest-1876305362 tempest-VolumesActionsTest-1876305362-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (789f9272-6c06-496f-83bd-184cd3013e84), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:07.024323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-be20d4f9-a808-4222-a48d-99989754f887 tempest-VolumesActionsTest-1876305362 tempest-VolumesActionsTest-1876305362-project] Security group member updated {'35fe4fab-f7e7-497f-b77d-71379dee8053'} Sep 30 09:48:07.030141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Resource SecurityGroup deleted: 0a54fafc-30d1-4260-b1f1-5dd5a50faec0 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:07.030141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (0a54fafc-30d1-4260-b1f1-5dd5a50faec0), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:07.030472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0a54fafc-30d1-4260-b1f1-5dd5a50faec0',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:48:07.047260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0a54fafc-30d1-4260-b1f1-5dd5a50faec0',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:48:07.055172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Resource SecurityGroupRule deleted: 3796c389-8cfc-4b74-8495-00c7ddcbcef4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:07.055862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (3796c389-8cfc-4b74-8495-00c7ddcbcef4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:07.058768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Security group rule updated ['0a54fafc-30d1-4260-b1f1-5dd5a50faec0'] Sep 30 09:48:07.058768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Resource SecurityGroupRule deleted: 3f77caac-69cf-4b8a-b482-e51794e7cac7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:07.058768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (3f77caac-69cf-4b8a-b482-e51794e7cac7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:07.059094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Security group rule updated ['0a54fafc-30d1-4260-b1f1-5dd5a50faec0'] Sep 30 09:48:07.059232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Resource SecurityGroupRule deleted: 8cab2396-31c3-4f71-bb7a-0d3527f567e4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:07.062441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8cab2396-31c3-4f71-bb7a-0d3527f567e4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:07.062829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Security group rule updated ['0a54fafc-30d1-4260-b1f1-5dd5a50faec0'] Sep 30 09:48:07.063449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Resource SecurityGroupRule deleted: e7e3221d-8bc6-43e4-8321-60e7d0006615 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:07.064683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e7e3221d-8bc6-43e4-8321-60e7d0006615), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:07.065030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1e8232c5-fa74-41d7-8190-713a3f6c2b52 admin admin] Security group rule updated ['0a54fafc-30d1-4260-b1f1-5dd5a50faec0'] Sep 30 09:48:07.164192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-14ebe7f8-46cc-4c01-be88-c426834aa97c None None] Resource Port 56cef7a4-f777-4bf3-94ed-8e22c13f3e1a updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=56cef7a4-f777-4bf3-94ed-8e22c13f3e1a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=56cef7a4-f777-4bf3-94ed-8e22c13f3e1a,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=56cef7a4-f777-4bf3-94ed-8e22c13f3e1a,segment=NetworkSegment(a76f9122-53fd-4f0a-a917-5e14511f12a6),segment_id=a76f9122-53fd-4f0a-a917-5e14511f12a6)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:07.164496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-14ebe7f8-46cc-4c01-be88-c426834aa97c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (56cef7a4-f777-4bf3-94ed-8e22c13f3e1a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:07.284653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5d249a69-bc33-4d2c-abbb-d71cffab6cbb","insert","tap56cef7a4-f7",["set",[]],["map",[["attached-mac","fa:16:3e:0e:0c:b5"],["iface-id","56cef7a4-f777-4bf3-94ed-8e22c13f3e1a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:07.304422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5d249a69-bc33-4d2c-abbb-d71cffab6cbb","old",null,["set",[]],null],["","new","tap56cef7a4-f7",18,["map",[["attached-mac","fa:16:3e:0e:0c:b5"],["iface-id","56cef7a4-f777-4bf3-94ed-8e22c13f3e1a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:07.591266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-02313bce-f6ba-4f7b-a19b-93d1f752edaa admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:06Z,data_plane_status=None,description='',device_id='53ae72e6-bca4-447f-a168-6530f8e978e7',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a7e8ba1a-cd90-4c12-a089-d7e77fa9531a,mac_address=fa:16:3e:c2:4d:ac,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a7e8ba1a-cd90-4c12-a089-d7e77fa9531a),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:48:07Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:07.592333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-02313bce-f6ba-4f7b-a19b-93d1f752edaa admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (a7e8ba1a-cd90-4c12-a089-d7e77fa9531a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:08.297995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:317 started Sep 30 09:48:08.310993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0418,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=801000000,duration_sec=646,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:08.310993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:08.310993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:317 - starting polling. Elapsed:0.005 Sep 30 09:48:08.310993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:08.311313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:317 - port information retrieved. Elapsed:0.010 Sep 30 09:48:08.311313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '0a907ef6-0733-4f96-9909-bd47d7e38800', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': {'56cef7a4-f777-4bf3-94ed-8e22c13f3e1a'}, 'removed': set(), 'updated': {'56cef7a4-f777-4bf3-94ed-8e22c13f3e1a'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:08.311457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-decc2ed9-0cd5-446c-93ae-1347454cf54d', 'network_id': 'decc2ed9-0cd5-446c-93ae-1347454cf54d', 'port_id': '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', 'mac_address': 'fa:16:3e:0e:0c:b5', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1bc9d9ab-4fb8-4e97-9d6f-78f2c2201033', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:08.318881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 56cef7a4-f777-4bf3-94ed-8e22c13f3e1a {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:08.319508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 56cef7a4-f777-4bf3-94ed-8e22c13f3e1a updated. Details: {'device': '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-decc2ed9-0cd5-446c-93ae-1347454cf54d', 'network_id': 'decc2ed9-0cd5-446c-93ae-1347454cf54d', 'port_id': '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', 'mac_address': 'fa:16:3e:0e:0c:b5', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1bc9d9ab-4fb8-4e97-9d6f-78f2c2201033', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:48:08.319977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 8 as local vlan for net-id=decc2ed9-0cd5-446c-93ae-1347454cf54d, seg-id=369 Sep 30 09:48:08.324714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xc9105ef4,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4465), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:08.328109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xf1c041a,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4104)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4465}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:08.329762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap56cef7a4-f7, col_values=(('tag', 8),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:08.330579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap56cef7a4-f7, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:08.331254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap56cef7a4-f7, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:08.341946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap56cef7a4-f7, col_values=(('other_config', {'net_uuid': 'decc2ed9-0cd5-446c-93ae-1347454cf54d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '369'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:08.356798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c041c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:08.358622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:317 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.049 Sep 30 09:48:08.359871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:48:08.360404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'56cef7a4-f777-4bf3-94ed-8e22c13f3e1a'} Sep 30 09:48:08.361856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:08.362488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:08.366827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:08.453398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[874c4828-a505-4132-a76d-7caf7168a8ca]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:08.454422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:317 - agent port security group processed in 0.146 Sep 30 09:48:08.455464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 56cef7a4-f777-4bf3-94ed-8e22c13f3e1a to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:08.673687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a1200738-cf9a-4b34-b770-b13c9dff3c79 None None] Resource Port 56cef7a4-f777-4bf3-94ed-8e22c13f3e1a updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:08.674807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a1200738-cf9a-4b34-b770-b13c9dff3c79 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (56cef7a4-f777-4bf3-94ed-8e22c13f3e1a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:08.924477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['56cef7a4-f777-4bf3-94ed-8e22c13f3e1a'] and devices down [] completed. Sep 30 09:48:08.924802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:317 - ports processed. Elapsed:0.627 Sep 30 09:48:08.925147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:317 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.627 Sep 30 09:48:09.620439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-fe54771a-b620-47a4-baf2-d85e0f9538ae None None] Resource Port a7e8ba1a-cd90-4c12-a089-d7e77fa9531a updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=a7e8ba1a-cd90-4c12-a089-d7e77fa9531a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a7e8ba1a-cd90-4c12-a089-d7e77fa9531a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:09.620824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-fe54771a-b620-47a4-baf2-d85e0f9538ae None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (a7e8ba1a-cd90-4c12-a089-d7e77fa9531a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:09.640964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-93449408-f956-4d6c-a0fb-cd28d8da4ede admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:09Z,data_plane_status=None,description='',device_id='53ae72e6-bca4-447f-a168-6530f8e978e7',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2795f7af-2ae3-4060-b5b3-8867e124821e,mac_address=fa:16:3e:1f:12:97,name='',network_id=decc2ed9-0cd5-446c-93ae-1347454cf54d,numa_affinity_policy=,project_id='ae05d51a1efc4c5398e9fa4ffeb7faa0',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2795f7af-2ae3-4060-b5b3-8867e124821e),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:48:09Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:09.641597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-93449408-f956-4d6c-a0fb-cd28d8da4ede admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (2795f7af-2ae3-4060-b5b3-8867e124821e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:10.116880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-fe54771a-b620-47a4-baf2-d85e0f9538ae None None] Resource Port a7e8ba1a-cd90-4c12-a089-d7e77fa9531a updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a7e8ba1a-cd90-4c12-a089-d7e77fa9531a,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=a7e8ba1a-cd90-4c12-a089-d7e77fa9531a,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a7e8ba1a-cd90-4c12-a089-d7e77fa9531a,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:10.119310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-fe54771a-b620-47a4-baf2-d85e0f9538ae None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (a7e8ba1a-cd90-4c12-a089-d7e77fa9531a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:10.217224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-93449408-f956-4d6c-a0fb-cd28d8da4ede admin admin] Received resource Port update without any changes: 2795f7af-2ae3-4060-b5b3-8867e124821e {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 30 09:48:10.299525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:318 started Sep 30 09:48:10.303248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c041e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=802000000,duration_sec=648,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:10.305213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:10.305851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:318 - starting polling. Elapsed:0.006 Sep 30 09:48:10.311732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:10.315015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:318 - port information retrieved. Elapsed:0.015 Sep 30 09:48:10.315608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '0a907ef6-0733-4f96-9909-bd47d7e38800', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': set(), 'removed': set(), 'updated': {'56cef7a4-f777-4bf3-94ed-8e22c13f3e1a'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:10.316404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-decc2ed9-0cd5-446c-93ae-1347454cf54d', 'network_id': 'decc2ed9-0cd5-446c-93ae-1347454cf54d', 'port_id': '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', 'mac_address': 'fa:16:3e:0e:0c:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1bc9d9ab-4fb8-4e97-9d6f-78f2c2201033', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:10.319491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 56cef7a4-f777-4bf3-94ed-8e22c13f3e1a {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:10.320257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 56cef7a4-f777-4bf3-94ed-8e22c13f3e1a updated. Details: {'device': '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-decc2ed9-0cd5-446c-93ae-1347454cf54d', 'network_id': 'decc2ed9-0cd5-446c-93ae-1347454cf54d', 'port_id': '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', 'mac_address': 'fa:16:3e:0e:0c:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1bc9d9ab-4fb8-4e97-9d6f-78f2c2201033', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Sep 30 09:48:10.324716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap56cef7a4-f7, col_values=(('tag', 8),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:10.325471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap56cef7a4-f7, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:10.326154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap56cef7a4-f7, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:10.326828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:10.328051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap56cef7a4-f7, col_values=(('other_config', {'net_uuid': 'decc2ed9-0cd5-446c-93ae-1347454cf54d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '369', 'tag': '8'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:10.328930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:10.332799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0420,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:10.333696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:318 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 14 devices currently available. Time elapsed: 0.017 Sep 30 09:48:10.334104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:48:10.334539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:48:10.335859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:10.336296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:10.340128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:10.403366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbeca19-1c85-403b-8617-6ab2941003f1]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:10.406785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:318 - agent port security group processed in 0.091 Sep 30 09:48:10.407866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 56cef7a4-f777-4bf3-94ed-8e22c13f3e1a to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:10.638398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['56cef7a4-f777-4bf3-94ed-8e22c13f3e1a'] and devices down [] completed. Sep 30 09:48:10.639087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:318 - ports processed. Elapsed:0.340 Sep 30 09:48:10.639573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:318 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.340 Sep 30 09:48:10.743580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["aa63e5af-e3fe-469e-87fb-1a88fd53a71c","insert","qr-2795f7af-2a",["set",[]],["map",[["attached-mac","fa:16:3e:1f:12:97"],["iface-id","2795f7af-2ae3-4060-b5b3-8867e124821e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:10.764184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["aa63e5af-e3fe-469e-87fb-1a88fd53a71c","old",null,["set",[]],null],["","new","qr-2795f7af-2a",19,["map",[["attached-mac","fa:16:3e:1f:12:97"],["iface-id","2795f7af-2ae3-4060-b5b3-8867e124821e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:10.980551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:10Z,description='Default security group',id=d4375fd2-14c8-4fde-a4f6-aa179cb5a33a,is_default=True,name='default',project_id='26c6db332c174ae1baaba70e175deca6',revision_number=1,rules=[SecurityGroupRule(71884c45-a92e-4d4e-87bd-4e25ccd4afe3),SecurityGroupRule(949d80f3-a20b-4c75-b2ad-a6d04522d04a),SecurityGroupRule(a9922381-7dc4-4912-9b42-dee965f0e31b),SecurityGroupRule(e348f7d7-945d-4e1b-960c-1c4ecdd0f114)],shared=False,stateful=True,updated_at=2022-09-30T09:48:10Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:10.981051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (d4375fd2-14c8-4fde-a4f6-aa179cb5a33a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:10.982751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:10Z,description=,direction='ingress',ethertype='IPv4',id=71884c45-a92e-4d4e-87bd-4e25ccd4afe3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='26c6db332c174ae1baaba70e175deca6',protocol=,remote_address_group_id=,remote_group_id=d4375fd2-14c8-4fde-a4f6-aa179cb5a33a,remote_ip_prefix=,revision_number=0,security_group_id=d4375fd2-14c8-4fde-a4f6-aa179cb5a33a,updated_at=2022-09-30T09:48:10Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:10.984247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (71884c45-a92e-4d4e-87bd-4e25ccd4afe3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:10.984542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Security group rule updated ['d4375fd2-14c8-4fde-a4f6-aa179cb5a33a'] Sep 30 09:48:10.985290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:10Z,description=,direction='egress',ethertype='IPv6',id=949d80f3-a20b-4c75-b2ad-a6d04522d04a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='26c6db332c174ae1baaba70e175deca6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d4375fd2-14c8-4fde-a4f6-aa179cb5a33a,updated_at=2022-09-30T09:48:10Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:10.985649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (949d80f3-a20b-4c75-b2ad-a6d04522d04a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:10.986266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Security group rule updated ['d4375fd2-14c8-4fde-a4f6-aa179cb5a33a'] Sep 30 09:48:10.993796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:10Z,description=,direction='egress',ethertype='IPv4',id=a9922381-7dc4-4912-9b42-dee965f0e31b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='26c6db332c174ae1baaba70e175deca6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d4375fd2-14c8-4fde-a4f6-aa179cb5a33a,updated_at=2022-09-30T09:48:10Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:10.993904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a9922381-7dc4-4912-9b42-dee965f0e31b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:10.994177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Security group rule updated ['d4375fd2-14c8-4fde-a4f6-aa179cb5a33a'] Sep 30 09:48:10.994934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:10Z,description=,direction='ingress',ethertype='IPv6',id=e348f7d7-945d-4e1b-960c-1c4ecdd0f114,normalized_cidr=None,port_range_max=,port_range_min=,project_id='26c6db332c174ae1baaba70e175deca6',protocol=,remote_address_group_id=,remote_group_id=d4375fd2-14c8-4fde-a4f6-aa179cb5a33a,remote_ip_prefix=,revision_number=0,security_group_id=d4375fd2-14c8-4fde-a4f6-aa179cb5a33a,updated_at=2022-09-30T09:48:10Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:10.995287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e348f7d7-945d-4e1b-960c-1c4ecdd0f114), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:10.995599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b7e280d6-1f03-45f7-8de6-efeade3ae29b admin admin] Security group rule updated ['d4375fd2-14c8-4fde-a4f6-aa179cb5a33a'] Sep 30 09:48:11.248707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["22250689-566d-442b-b653-3fae5dceed2f","insert","qg-a7e8ba1a-cd",["set",[]],["map",[["attached-mac","fa:16:3e:c2:4d:ac"],["iface-id","a7e8ba1a-cd90-4c12-a089-d7e77fa9531a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:11.288023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["22250689-566d-442b-b653-3fae5dceed2f","old",null,["set",[]],null],["","new","qg-a7e8ba1a-cd",20,["map",[["attached-mac","fa:16:3e:c2:4d:ac"],["iface-id","a7e8ba1a-cd90-4c12-a089-d7e77fa9531a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:11.313145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Resource SecurityGroup deleted: d4375fd2-14c8-4fde-a4f6-aa179cb5a33a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:11.313145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (d4375fd2-14c8-4fde-a4f6-aa179cb5a33a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:11.313145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d4375fd2-14c8-4fde-a4f6-aa179cb5a33a',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:48:11.331631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d4375fd2-14c8-4fde-a4f6-aa179cb5a33a',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:48:11.332097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Resource SecurityGroupRule deleted: 71884c45-a92e-4d4e-87bd-4e25ccd4afe3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:11.332880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (71884c45-a92e-4d4e-87bd-4e25ccd4afe3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:11.332880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Security group rule updated ['d4375fd2-14c8-4fde-a4f6-aa179cb5a33a'] Sep 30 09:48:11.333215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Resource SecurityGroupRule deleted: 949d80f3-a20b-4c75-b2ad-a6d04522d04a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:11.333552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (949d80f3-a20b-4c75-b2ad-a6d04522d04a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:11.333869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Security group rule updated ['d4375fd2-14c8-4fde-a4f6-aa179cb5a33a'] Sep 30 09:48:11.334239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Resource SecurityGroupRule deleted: a9922381-7dc4-4912-9b42-dee965f0e31b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:11.334580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a9922381-7dc4-4912-9b42-dee965f0e31b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:11.335131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Security group rule updated ['d4375fd2-14c8-4fde-a4f6-aa179cb5a33a'] Sep 30 09:48:11.335502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Resource SecurityGroupRule deleted: e348f7d7-945d-4e1b-960c-1c4ecdd0f114 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:11.335836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e348f7d7-945d-4e1b-960c-1c4ecdd0f114), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:11.336146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9f373337-bb7c-40cd-a440-ecc43be2ab28 admin admin] Security group rule updated ['d4375fd2-14c8-4fde-a4f6-aa179cb5a33a'] Sep 30 09:48:12.286495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:12Z,description='Default security group',id=49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e,is_default=True,name='default',project_id='17bfa06fa180441992ad20f3d523561f',revision_number=1,rules=[SecurityGroupRule(20dcb1cb-0f14-4307-9106-1ec6d5c775d8),SecurityGroupRule(7b9de05c-dc24-4ef6-ae10-80c0c0613de0),SecurityGroupRule(87f0df73-a6c7-4285-a001-80b30337af61),SecurityGroupRule(d3114b60-913a-4e2f-ae32-37d158a39c3b)],shared=False,stateful=True,updated_at=2022-09-30T09:48:12Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:12.287453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:12.287731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:12Z,description=,direction='egress',ethertype='IPv6',id=20dcb1cb-0f14-4307-9106-1ec6d5c775d8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='17bfa06fa180441992ad20f3d523561f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e,updated_at=2022-09-30T09:48:12Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:12.291385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (20dcb1cb-0f14-4307-9106-1ec6d5c775d8), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:12.291385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Security group rule updated ['49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e'] Sep 30 09:48:12.291385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:12Z,description=,direction='ingress',ethertype='IPv6',id=7b9de05c-dc24-4ef6-ae10-80c0c0613de0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='17bfa06fa180441992ad20f3d523561f',protocol=,remote_address_group_id=,remote_group_id=49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e,remote_ip_prefix=,revision_number=0,security_group_id=49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e,updated_at=2022-09-30T09:48:12Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:12.291385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7b9de05c-dc24-4ef6-ae10-80c0c0613de0), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:12.291761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Security group rule updated ['49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e'] Sep 30 09:48:12.291761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:12Z,description=,direction='egress',ethertype='IPv4',id=87f0df73-a6c7-4285-a001-80b30337af61,normalized_cidr=None,port_range_max=,port_range_min=,project_id='17bfa06fa180441992ad20f3d523561f',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e,updated_at=2022-09-30T09:48:12Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:12.291761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (87f0df73-a6c7-4285-a001-80b30337af61), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:12.291761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Security group rule updated ['49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e'] Sep 30 09:48:12.292223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:12Z,description=,direction='ingress',ethertype='IPv4',id=d3114b60-913a-4e2f-ae32-37d158a39c3b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='17bfa06fa180441992ad20f3d523561f',protocol=,remote_address_group_id=,remote_group_id=49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e,remote_ip_prefix=,revision_number=0,security_group_id=49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e,updated_at=2022-09-30T09:48:12Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:12.292580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d3114b60-913a-4e2f-ae32-37d158a39c3b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:12.292902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5f3fb81f-9063-48e0-9516-b749d2051071 admin admin] Security group rule updated ['49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e'] Sep 30 09:48:12.301292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:319 started Sep 30 09:48:12.305146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0422,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=804000000,duration_sec=650,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:12.306694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:12.307245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:319 - starting polling. Elapsed:0.006 Sep 30 09:48:12.312382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:12.315557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:319 - port information retrieved. Elapsed:0.014 Sep 30 09:48:12.316070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '0a907ef6-0733-4f96-9909-bd47d7e38800', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', 'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'added': {'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', '2795f7af-2ae3-4060-b5b3-8867e124821e'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:12.316868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', 'device_id': '53ae72e6-bca4-447f-a168-6530f8e978e7', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', 'mac_address': 'fa:16:3e:c2:4d:ac', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.39'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:12.317489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: WARNING neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:09Z,data_plane_status=None,description='',device_id='53ae72e6-bca4-447f-a168-6530f8e978e7',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2795f7af-2ae3-4060-b5b3-8867e124821e,mac_address=fa:16:3e:1f:12:97,name='',network_id=decc2ed9-0cd5-446c-93ae-1347454cf54d,numa_affinity_policy=,project_id='ae05d51a1efc4c5398e9fa4ffeb7faa0',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(2795f7af-2ae3-4060-b5b3-8867e124821e),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:48:09Z) is not bound. Sep 30 09:48:12.320481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: a7e8ba1a-cd90-4c12-a089-d7e77fa9531a {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:12.320799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port a7e8ba1a-cd90-4c12-a089-d7e77fa9531a updated. Details: {'device': 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', 'device_id': '53ae72e6-bca4-447f-a168-6530f8e978e7', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', 'mac_address': 'fa:16:3e:c2:4d:ac', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.39'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:48:12.322053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a7e8ba1a-cd, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:12.322751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-a7e8ba1a-cd, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:12.323370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-a7e8ba1a-cd, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:12.333926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a7e8ba1a-cd, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:12.346230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0424,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:12.346667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 2795f7af-2ae3-4060-b5b3-8867e124821e {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:12.347038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Device 2795f7af-2ae3-4060-b5b3-8867e124821e not defined on plugin or binding failed Sep 30 09:48:12.347627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:319 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.031 Sep 30 09:48:12.348034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 2 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:48:12.355183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', '2795f7af-2ae3-4060-b5b3-8867e124821e'} Sep 30 09:48:12.357139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:12.357496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:12.364049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:12.468670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f441b304-cdbd-4e39-b37d-cf842e9e543c]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:12.469461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:319 - agent port security group processed in 0.153 Sep 30 09:48:12.470220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for a7e8ba1a-cd90-4c12-a089-d7e77fa9531a to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:12.599329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Resource SecurityGroup deleted: 49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:12.599708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:12.600176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:48:12.752934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:48:12.753406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Resource SecurityGroupRule deleted: 20dcb1cb-0f14-4307-9106-1ec6d5c775d8 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:12.753767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (20dcb1cb-0f14-4307-9106-1ec6d5c775d8), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:12.754293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Security group rule updated ['49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e'] Sep 30 09:48:12.754874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Resource SecurityGroupRule deleted: 7b9de05c-dc24-4ef6-ae10-80c0c0613de0 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:12.755368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7b9de05c-dc24-4ef6-ae10-80c0c0613de0), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:12.761045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Security group rule updated ['49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e'] Sep 30 09:48:12.761045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Resource SecurityGroupRule deleted: 87f0df73-a6c7-4285-a001-80b30337af61 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:12.761045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (87f0df73-a6c7-4285-a001-80b30337af61), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:12.761045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Security group rule updated ['49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e'] Sep 30 09:48:12.761045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Resource SecurityGroupRule deleted: d3114b60-913a-4e2f-ae32-37d158a39c3b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:12.761422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d3114b60-913a-4e2f-ae32-37d158a39c3b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:12.761422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cc0ea6f2-81cf-4913-b735-dc780998ba1a admin admin] Security group rule updated ['49f94e9c-0dd0-4fd3-ab3d-41f777e08a0e'] Sep 30 09:48:13.842560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'] and devices down [] completed. Sep 30 09:48:13.843124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:319 - ports processed. Elapsed:1.541 Sep 30 09:48:13.843124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:319 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 0, 'removed': 0}}. Elapsed:1.542 Sep 30 09:48:14.060231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port a7e8ba1a-cd90-4c12-a089-d7e77fa9531a updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a7e8ba1a-cd90-4c12-a089-d7e77fa9531a,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=a7e8ba1a-cd90-4c12-a089-d7e77fa9531a,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:14.061357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (a7e8ba1a-cd90-4c12-a089-d7e77fa9531a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:14.076202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c05c6fa8-82ef-4126-adc5-c6d7ffe48f75 service neutron] Resource Port 789f9272-6c06-496f-83bd-184cd3013e84 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=789f9272-6c06-496f-83bd-184cd3013e84,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=789f9272-6c06-496f-83bd-184cd3013e84,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:14.076954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c05c6fa8-82ef-4126-adc5-c6d7ffe48f75 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (789f9272-6c06-496f-83bd-184cd3013e84), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:14.302736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:320 started Sep 30 09:48:14.305751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0426,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=805000000,duration_sec=652,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:14.312553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:14.312553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:320 - starting polling. Elapsed:0.004 Sep 30 09:48:14.312553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:14.314543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:320 - port information retrieved. Elapsed:0.012 Sep 30 09:48:14.315175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': set(), 'removed': set(), 'updated': {'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:14.316007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', 'device_id': '53ae72e6-bca4-447f-a168-6530f8e978e7', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', 'mac_address': 'fa:16:3e:c2:4d:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.39'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:14.319267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: a7e8ba1a-cd90-4c12-a089-d7e77fa9531a {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:14.321387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port a7e8ba1a-cd90-4c12-a089-d7e77fa9531a updated. Details: {'device': 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', 'device_id': '53ae72e6-bca4-447f-a168-6530f8e978e7', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', 'mac_address': 'fa:16:3e:c2:4d:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.39'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:48:14.325218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a7e8ba1a-cd, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:14.325867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-a7e8ba1a-cd, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:14.326271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-a7e8ba1a-cd, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:14.326758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:14.327510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-a7e8ba1a-cd, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:14.328403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:14.330744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0428,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:14.331436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:320 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.016 Sep 30 09:48:14.331985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:48:14.332474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:48:14.333822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:14.334310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:14.338922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:14.421219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[decaed58-ff5c-4628-ba4d-788f4314f1e6]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:14.421983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:320 - agent port security group processed in 0.106 Sep 30 09:48:14.422994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for a7e8ba1a-cd90-4c12-a089-d7e77fa9531a to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:14.935669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'] and devices down [] completed. Sep 30 09:48:14.935669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:320 - ports processed. Elapsed:0.630 Sep 30 09:48:14.935669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:320 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.631 Sep 30 09:48:15.548178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c05c6fa8-82ef-4126-adc5-c6d7ffe48f75 service neutron] Resource Port 789f9272-6c06-496f-83bd-184cd3013e84 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=789f9272-6c06-496f-83bd-184cd3013e84,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=789f9272-6c06-496f-83bd-184cd3013e84,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=789f9272-6c06-496f-83bd-184cd3013e84,segment=NetworkSegment(11f0f416-ce09-4705-9d84-2507bb4fe522),segment_id=11f0f416-ce09-4705-9d84-2507bb4fe522)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:15.548910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c05c6fa8-82ef-4126-adc5-c6d7ffe48f75 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (789f9272-6c06-496f-83bd-184cd3013e84), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:15.671333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7227a090-b720-4c4e-bbc1-db8c74d042f8 None None] Resource Port 2795f7af-2ae3-4060-b5b3-8867e124821e updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=2795f7af-2ae3-4060-b5b3-8867e124821e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2795f7af-2ae3-4060-b5b3-8867e124821e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:15.671333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7227a090-b720-4c4e-bbc1-db8c74d042f8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (2795f7af-2ae3-4060-b5b3-8867e124821e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:15.819273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:15Z,description='Default security group',id=de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4,is_default=True,name='default',project_id='d6413896cf7941dc9f287e9e9ef42498',revision_number=1,rules=[SecurityGroupRule(37eec122-deb1-4d1a-bf33-3186ebcc491e),SecurityGroupRule(a38c4216-5f45-4046-81bd-b0b21c9c964a),SecurityGroupRule(cb4d1439-b44e-4526-9fba-696c978d1e65),SecurityGroupRule(e2adbde4-3077-4e73-afe0-fe15ac88416d)],shared=False,stateful=True,updated_at=2022-09-30T09:48:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:15.819638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:15.820257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:15Z,description=,direction='ingress',ethertype='IPv6',id=37eec122-deb1-4d1a-bf33-3186ebcc491e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d6413896cf7941dc9f287e9e9ef42498',protocol=,remote_address_group_id=,remote_group_id=de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4,remote_ip_prefix=,revision_number=0,security_group_id=de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4,updated_at=2022-09-30T09:48:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:15.820612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (37eec122-deb1-4d1a-bf33-3186ebcc491e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:15.820940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Security group rule updated ['de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4'] Sep 30 09:48:15.821764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:15Z,description=,direction='ingress',ethertype='IPv4',id=a38c4216-5f45-4046-81bd-b0b21c9c964a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d6413896cf7941dc9f287e9e9ef42498',protocol=,remote_address_group_id=,remote_group_id=de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4,remote_ip_prefix=,revision_number=0,security_group_id=de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4,updated_at=2022-09-30T09:48:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:15.822121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a38c4216-5f45-4046-81bd-b0b21c9c964a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:15.822440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Security group rule updated ['de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4'] Sep 30 09:48:15.823169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:15Z,description=,direction='egress',ethertype='IPv6',id=cb4d1439-b44e-4526-9fba-696c978d1e65,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d6413896cf7941dc9f287e9e9ef42498',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4,updated_at=2022-09-30T09:48:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:15.823542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (cb4d1439-b44e-4526-9fba-696c978d1e65), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:15.823830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Security group rule updated ['de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4'] Sep 30 09:48:15.825941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:15Z,description=,direction='egress',ethertype='IPv4',id=e2adbde4-3077-4e73-afe0-fe15ac88416d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d6413896cf7941dc9f287e9e9ef42498',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4,updated_at=2022-09-30T09:48:15Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:15.826510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e2adbde4-3077-4e73-afe0-fe15ac88416d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:15.829303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2e1c7537-d284-4f4a-ad51-4abce2a3805b admin admin] Security group rule updated ['de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4'] Sep 30 09:48:16.134739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7227a090-b720-4c4e-bbc1-db8c74d042f8 None None] Resource Port 2795f7af-2ae3-4060-b5b3-8867e124821e updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2795f7af-2ae3-4060-b5b3-8867e124821e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2795f7af-2ae3-4060-b5b3-8867e124821e,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=2795f7af-2ae3-4060-b5b3-8867e124821e,segment=NetworkSegment(a76f9122-53fd-4f0a-a917-5e14511f12a6),segment_id=a76f9122-53fd-4f0a-a917-5e14511f12a6)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:16.136679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7227a090-b720-4c4e-bbc1-db8c74d042f8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (2795f7af-2ae3-4060-b5b3-8867e124821e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:16.215653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Resource SecurityGroup deleted: de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:16.216590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:16.216998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:48:16.305234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:48:16.305917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Resource SecurityGroupRule deleted: 37eec122-deb1-4d1a-bf33-3186ebcc491e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:16.306813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (37eec122-deb1-4d1a-bf33-3186ebcc491e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:16.307315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Security group rule updated ['de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4'] Sep 30 09:48:16.307843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Resource SecurityGroupRule deleted: a38c4216-5f45-4046-81bd-b0b21c9c964a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:16.308340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a38c4216-5f45-4046-81bd-b0b21c9c964a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:16.308973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Security group rule updated ['de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4'] Sep 30 09:48:16.309500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Resource SecurityGroupRule deleted: cb4d1439-b44e-4526-9fba-696c978d1e65 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:16.310788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (cb4d1439-b44e-4526-9fba-696c978d1e65), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:16.315053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Security group rule updated ['de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4'] Sep 30 09:48:16.315053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Resource SecurityGroupRule deleted: e2adbde4-3077-4e73-afe0-fe15ac88416d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:16.315053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e2adbde4-3077-4e73-afe0-fe15ac88416d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:16.315053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7d13b9d9-b011-4ec1-8fec-4210c56148d5 admin admin] Security group rule updated ['de16fe59-51f1-4c6a-a0bc-29ecd3f09ac4'] Sep 30 09:48:16.315053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:321 started Sep 30 09:48:16.317177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c042a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=816000000,duration_sec=654,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:16.319738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:16.320261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:321 - starting polling. Elapsed:0.007 Sep 30 09:48:16.330599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:16.347106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:321 - port information retrieved. Elapsed:0.028 Sep 30 09:48:16.349555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': set(), 'removed': set(), 'updated': {'2795f7af-2ae3-4060-b5b3-8867e124821e'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:16.351765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '2795f7af-2ae3-4060-b5b3-8867e124821e', 'device_id': '53ae72e6-bca4-447f-a168-6530f8e978e7', 'network_id': 'decc2ed9-0cd5-446c-93ae-1347454cf54d', 'port_id': '2795f7af-2ae3-4060-b5b3-8867e124821e', 'mac_address': 'fa:16:3e:1f:12:97', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1bc9d9ab-4fb8-4e97-9d6f-78f2c2201033', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:16.377714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 2795f7af-2ae3-4060-b5b3-8867e124821e {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:16.379441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 2795f7af-2ae3-4060-b5b3-8867e124821e updated. Details: {'device': '2795f7af-2ae3-4060-b5b3-8867e124821e', 'device_id': '53ae72e6-bca4-447f-a168-6530f8e978e7', 'network_id': 'decc2ed9-0cd5-446c-93ae-1347454cf54d', 'port_id': '2795f7af-2ae3-4060-b5b3-8867e124821e', 'mac_address': 'fa:16:3e:1f:12:97', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1bc9d9ab-4fb8-4e97-9d6f-78f2c2201033', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Sep 30 09:48:16.381132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-2795f7af-2a, col_values=(('tag', 8),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:16.384463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-2795f7af-2a, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:16.391615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-2795f7af-2a, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:16.415454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-2795f7af-2a, col_values=(('other_config', {'net_uuid': 'decc2ed9-0cd5-446c-93ae-1347454cf54d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '8', 'segmentation_id': '369'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:16.445609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c042c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:16.449137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:321 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.098 Sep 30 09:48:16.450316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:48:16.453914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:48:16.460558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:16.474343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:16.489265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:16.629290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2cdf8e-daa7-4fd7-bc40-482474941293]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:16.629976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:321 - agent port security group processed in 0.279 Sep 30 09:48:16.631055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 2795f7af-2ae3-4060-b5b3-8867e124821e to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:16.816873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4682f2fe-5335-4e7a-8668-14a06aa4df96 None None] Resource Port 2795f7af-2ae3-4060-b5b3-8867e124821e updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:16.818136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4682f2fe-5335-4e7a-8668-14a06aa4df96 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (2795f7af-2ae3-4060-b5b3-8867e124821e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:17.030140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['2795f7af-2ae3-4060-b5b3-8867e124821e'] and devices down [] completed. Sep 30 09:48:17.030912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:321 - ports processed. Elapsed:0.718 Sep 30 09:48:17.031433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:321 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.718 Sep 30 09:48:18.319570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:322 started Sep 30 09:48:18.319570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c042e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=817000000,duration_sec=656,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:18.319570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:18.319570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:322 - starting polling. Elapsed:0.004 Sep 30 09:48:18.321266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:18.330539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:322 - port information retrieved. Elapsed:0.016 Sep 30 09:48:18.332208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': set(), 'removed': set(), 'updated': {'2795f7af-2ae3-4060-b5b3-8867e124821e'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:18.333857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '2795f7af-2ae3-4060-b5b3-8867e124821e', 'device_id': '53ae72e6-bca4-447f-a168-6530f8e978e7', 'network_id': 'decc2ed9-0cd5-446c-93ae-1347454cf54d', 'port_id': '2795f7af-2ae3-4060-b5b3-8867e124821e', 'mac_address': 'fa:16:3e:1f:12:97', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1bc9d9ab-4fb8-4e97-9d6f-78f2c2201033', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:18.338932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 2795f7af-2ae3-4060-b5b3-8867e124821e {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:18.341469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 2795f7af-2ae3-4060-b5b3-8867e124821e updated. Details: {'device': '2795f7af-2ae3-4060-b5b3-8867e124821e', 'device_id': '53ae72e6-bca4-447f-a168-6530f8e978e7', 'network_id': 'decc2ed9-0cd5-446c-93ae-1347454cf54d', 'port_id': '2795f7af-2ae3-4060-b5b3-8867e124821e', 'mac_address': 'fa:16:3e:1f:12:97', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 369, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '1bc9d9ab-4fb8-4e97-9d6f-78f2c2201033', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 8} Sep 30 09:48:18.345398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-2795f7af-2a, col_values=(('tag', 8),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:18.349688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-2795f7af-2a, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:18.350320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-2795f7af-2a, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:18.358409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:18.358409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-2795f7af-2a, col_values=(('other_config', {'net_uuid': 'decc2ed9-0cd5-446c-93ae-1347454cf54d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '369', 'tag': '8'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:18.358409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:18.358409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0430,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:18.358409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:322 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 16 devices currently available. Time elapsed: 0.025 Sep 30 09:48:18.359233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:48:18.360832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:48:18.363961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:18.364554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:18.373414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:18.458758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dee62d9-5e98-4259-ba3e-7b113ad86c44]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:18.459851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:322 - agent port security group processed in 0.126 Sep 30 09:48:18.462033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 2795f7af-2ae3-4060-b5b3-8867e124821e to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:18.803205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['2795f7af-2ae3-4060-b5b3-8867e124821e'] and devices down [] completed. Sep 30 09:48:18.803849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:322 - ports processed. Elapsed:0.489 Sep 30 09:48:18.804351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:322 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.490 Sep 30 09:48:18.849443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 789f9272-6c06-496f-83bd-184cd3013e84 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:18.849824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (789f9272-6c06-496f-83bd-184cd3013e84), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:19.463780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:19Z,description='Default security group',id=7e88a0a7-429c-4fb9-afaa-71b2c8996583,is_default=True,name='default',project_id='2ff64158d3244f299d9a50abd9af4be4',revision_number=1,rules=[SecurityGroupRule(0e27b127-9ef6-4df7-acdc-fc47f055664f),SecurityGroupRule(4a068a0e-e191-4806-b3f0-83252108b24e),SecurityGroupRule(99a4be87-0dbd-4bfc-a874-dc9225168cf7),SecurityGroupRule(c623f63d-da3b-4c86-8b00-592465693f2d)],shared=False,stateful=True,updated_at=2022-09-30T09:48:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:19.464473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (7e88a0a7-429c-4fb9-afaa-71b2c8996583), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:19.468306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:19Z,description=,direction='egress',ethertype='IPv6',id=0e27b127-9ef6-4df7-acdc-fc47f055664f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ff64158d3244f299d9a50abd9af4be4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7e88a0a7-429c-4fb9-afaa-71b2c8996583,updated_at=2022-09-30T09:48:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:19.468306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (0e27b127-9ef6-4df7-acdc-fc47f055664f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:19.468306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Security group rule updated ['7e88a0a7-429c-4fb9-afaa-71b2c8996583'] Sep 30 09:48:19.468770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:19Z,description=,direction='ingress',ethertype='IPv6',id=4a068a0e-e191-4806-b3f0-83252108b24e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ff64158d3244f299d9a50abd9af4be4',protocol=,remote_address_group_id=,remote_group_id=7e88a0a7-429c-4fb9-afaa-71b2c8996583,remote_ip_prefix=,revision_number=0,security_group_id=7e88a0a7-429c-4fb9-afaa-71b2c8996583,updated_at=2022-09-30T09:48:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:19.468770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4a068a0e-e191-4806-b3f0-83252108b24e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:19.468770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Security group rule updated ['7e88a0a7-429c-4fb9-afaa-71b2c8996583'] Sep 30 09:48:19.469102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:19Z,description=,direction='egress',ethertype='IPv4',id=99a4be87-0dbd-4bfc-a874-dc9225168cf7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ff64158d3244f299d9a50abd9af4be4',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7e88a0a7-429c-4fb9-afaa-71b2c8996583,updated_at=2022-09-30T09:48:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:19.469102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (99a4be87-0dbd-4bfc-a874-dc9225168cf7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:19.469102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Security group rule updated ['7e88a0a7-429c-4fb9-afaa-71b2c8996583'] Sep 30 09:48:19.469708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:19Z,description=,direction='ingress',ethertype='IPv4',id=c623f63d-da3b-4c86-8b00-592465693f2d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2ff64158d3244f299d9a50abd9af4be4',protocol=,remote_address_group_id=,remote_group_id=7e88a0a7-429c-4fb9-afaa-71b2c8996583,remote_ip_prefix=,revision_number=0,security_group_id=7e88a0a7-429c-4fb9-afaa-71b2c8996583,updated_at=2022-09-30T09:48:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:19.470059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c623f63d-da3b-4c86-8b00-592465693f2d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:19.470379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b77f78fd-81c6-4286-9f76-838399a8355e admin admin] Security group rule updated ['7e88a0a7-429c-4fb9-afaa-71b2c8996583'] Sep 30 09:48:19.811759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Resource SecurityGroup deleted: 7e88a0a7-429c-4fb9-afaa-71b2c8996583 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:19.812228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (7e88a0a7-429c-4fb9-afaa-71b2c8996583), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:19.812762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7e88a0a7-429c-4fb9-afaa-71b2c8996583',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:48:19.829110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7e88a0a7-429c-4fb9-afaa-71b2c8996583',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:48:19.829594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Resource SecurityGroupRule deleted: 0e27b127-9ef6-4df7-acdc-fc47f055664f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:19.829949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (0e27b127-9ef6-4df7-acdc-fc47f055664f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:19.830376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Security group rule updated ['7e88a0a7-429c-4fb9-afaa-71b2c8996583'] Sep 30 09:48:19.830948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Resource SecurityGroupRule deleted: 4a068a0e-e191-4806-b3f0-83252108b24e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:19.831177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4a068a0e-e191-4806-b3f0-83252108b24e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:19.831492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Security group rule updated ['7e88a0a7-429c-4fb9-afaa-71b2c8996583'] Sep 30 09:48:19.832007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Resource SecurityGroupRule deleted: 99a4be87-0dbd-4bfc-a874-dc9225168cf7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:19.832348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (99a4be87-0dbd-4bfc-a874-dc9225168cf7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:19.832687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Security group rule updated ['7e88a0a7-429c-4fb9-afaa-71b2c8996583'] Sep 30 09:48:19.833095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Resource SecurityGroupRule deleted: c623f63d-da3b-4c86-8b00-592465693f2d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:19.833551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c623f63d-da3b-4c86-8b00-592465693f2d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:19.833927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4bd9f748-1b10-42bc-bd80-cfe04c306cf7 admin admin] Security group rule updated ['7e88a0a7-429c-4fb9-afaa-71b2c8996583'] Sep 30 09:48:20.316249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:323 started Sep 30 09:48:20.319540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0432,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=819000000,duration_sec=658,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:20.320476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:20.320825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:323 - starting polling. Elapsed:0.005 Sep 30 09:48:20.323661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:20.327865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:323 - port information retrieved. Elapsed:0.012 Sep 30 09:48:20.328514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:323 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 30 09:48:20.712837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:20Z,description='Default security group',id=7b6d0010-f42c-4a65-809c-41df969d87f8,is_default=True,name='default',project_id='587193b710ea403bade7288be6ec5f84',revision_number=1,rules=[SecurityGroupRule(36382a3d-a72c-4c65-8dfb-d65f3ca58ea1),SecurityGroupRule(51929c1d-6973-4c67-97ab-406f86a4911e),SecurityGroupRule(da2c4f55-5e53-456c-9b51-b5642f35548f),SecurityGroupRule(f21c43f4-9931-4efa-8988-06e161a1074e)],shared=False,stateful=True,updated_at=2022-09-30T09:48:20Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:20.714034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (7b6d0010-f42c-4a65-809c-41df969d87f8), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:20.715751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:20Z,description=,direction='egress',ethertype='IPv4',id=36382a3d-a72c-4c65-8dfb-d65f3ca58ea1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='587193b710ea403bade7288be6ec5f84',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7b6d0010-f42c-4a65-809c-41df969d87f8,updated_at=2022-09-30T09:48:20Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:20.716229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (36382a3d-a72c-4c65-8dfb-d65f3ca58ea1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:20.717510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Security group rule updated ['7b6d0010-f42c-4a65-809c-41df969d87f8'] Sep 30 09:48:20.719433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:20Z,description=,direction='egress',ethertype='IPv6',id=51929c1d-6973-4c67-97ab-406f86a4911e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='587193b710ea403bade7288be6ec5f84',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=7b6d0010-f42c-4a65-809c-41df969d87f8,updated_at=2022-09-30T09:48:20Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:20.719917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (51929c1d-6973-4c67-97ab-406f86a4911e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:20.721537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Security group rule updated ['7b6d0010-f42c-4a65-809c-41df969d87f8'] Sep 30 09:48:20.722345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:20Z,description=,direction='ingress',ethertype='IPv6',id=da2c4f55-5e53-456c-9b51-b5642f35548f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='587193b710ea403bade7288be6ec5f84',protocol=,remote_address_group_id=,remote_group_id=7b6d0010-f42c-4a65-809c-41df969d87f8,remote_ip_prefix=,revision_number=0,security_group_id=7b6d0010-f42c-4a65-809c-41df969d87f8,updated_at=2022-09-30T09:48:20Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:20.725647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (da2c4f55-5e53-456c-9b51-b5642f35548f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:20.727225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Security group rule updated ['7b6d0010-f42c-4a65-809c-41df969d87f8'] Sep 30 09:48:20.730800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:20Z,description=,direction='ingress',ethertype='IPv4',id=f21c43f4-9931-4efa-8988-06e161a1074e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='587193b710ea403bade7288be6ec5f84',protocol=,remote_address_group_id=,remote_group_id=7b6d0010-f42c-4a65-809c-41df969d87f8,remote_ip_prefix=,revision_number=0,security_group_id=7b6d0010-f42c-4a65-809c-41df969d87f8,updated_at=2022-09-30T09:48:20Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:20.741702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f21c43f4-9931-4efa-8988-06e161a1074e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:20.741702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7fc4ea22-fa23-4131-8c51-5e7fa41d3e83 admin admin] Security group rule updated ['7b6d0010-f42c-4a65-809c-41df969d87f8'] Sep 30 09:48:20.961713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Resource SecurityGroup deleted: 7b6d0010-f42c-4a65-809c-41df969d87f8 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:20.962338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (7b6d0010-f42c-4a65-809c-41df969d87f8), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:20.963285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('7b6d0010-f42c-4a65-809c-41df969d87f8',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:48:20.981513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('7b6d0010-f42c-4a65-809c-41df969d87f8',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:48:20.982211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Resource SecurityGroupRule deleted: 36382a3d-a72c-4c65-8dfb-d65f3ca58ea1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:20.986205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (36382a3d-a72c-4c65-8dfb-d65f3ca58ea1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:20.986205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Security group rule updated ['7b6d0010-f42c-4a65-809c-41df969d87f8'] Sep 30 09:48:20.986205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Resource SecurityGroupRule deleted: 51929c1d-6973-4c67-97ab-406f86a4911e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:20.986205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (51929c1d-6973-4c67-97ab-406f86a4911e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:20.986205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Security group rule updated ['7b6d0010-f42c-4a65-809c-41df969d87f8'] Sep 30 09:48:20.986649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Resource SecurityGroupRule deleted: da2c4f55-5e53-456c-9b51-b5642f35548f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:20.986649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (da2c4f55-5e53-456c-9b51-b5642f35548f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:20.986649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Security group rule updated ['7b6d0010-f42c-4a65-809c-41df969d87f8'] Sep 30 09:48:20.986649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Resource SecurityGroupRule deleted: f21c43f4-9931-4efa-8988-06e161a1074e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:20.986649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f21c43f4-9931-4efa-8988-06e161a1074e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:20.987079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f90d9219-98cb-4891-a74b-db3bee870d52 admin admin] Security group rule updated ['7b6d0010-f42c-4a65-809c-41df969d87f8'] Sep 30 09:48:22.321413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:324 started Sep 30 09:48:22.323977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0434,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=824000000,duration_sec=660,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:22.333256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:22.333793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:324 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 30 09:48:23.077502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 789f9272-6c06-496f-83bd-184cd3013e84 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:23.077884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (789f9272-6c06-496f-83bd-184cd3013e84), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:24.322073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:325 started Sep 30 09:48:24.327054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0436,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=825000000,duration_sec=662,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:24.328547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:24.329078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:325 - starting polling. Elapsed:0.007 Sep 30 09:48:24.331499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:24.345031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:325 - port information retrieved. Elapsed:0.023 Sep 30 09:48:24.345535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:325 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.024 Sep 30 09:48:26.323108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:326 started Sep 30 09:48:26.327246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0438,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=826000000,duration_sec=664,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:26.327835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:26.328187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:326 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:48:26.691310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-85112953-f740-4b81-9e93-d857a713cf4d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:26Z,description='tempest-description--939957438',id=47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf,is_default=False,name='tempest-securitygroup--703128740',project_id='86e6b0501cb94028be07bddd2182638b',revision_number=1,rules=[SecurityGroupRule(322a2712-e565-4074-a162-d57f991184b3),SecurityGroupRule(ea187453-4236-4e2b-a39b-abbbcfae5af4)],shared=False,stateful=True,updated_at=2022-09-30T09:48:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:26.691711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-85112953-f740-4b81-9e93-d857a713cf4d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:26.692371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-85112953-f740-4b81-9e93-d857a713cf4d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:26Z,description=,direction='egress',ethertype='IPv6',id=322a2712-e565-4074-a162-d57f991184b3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf,updated_at=2022-09-30T09:48:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:26.692733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-85112953-f740-4b81-9e93-d857a713cf4d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (322a2712-e565-4074-a162-d57f991184b3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:26.693070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-85112953-f740-4b81-9e93-d857a713cf4d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf'] Sep 30 09:48:26.693777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-85112953-f740-4b81-9e93-d857a713cf4d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:26Z,description=,direction='egress',ethertype='IPv4',id=ea187453-4236-4e2b-a39b-abbbcfae5af4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf,updated_at=2022-09-30T09:48:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:26.694131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-85112953-f740-4b81-9e93-d857a713cf4d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (ea187453-4236-4e2b-a39b-abbbcfae5af4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:26.694463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-85112953-f740-4b81-9e93-d857a713cf4d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf'] Sep 30 09:48:27.095469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5cc647a5-0f9a-4048-b841-96c33fd32030 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:26Z,description='',direction='ingress',ethertype='IPv4',id=e16146d2-6700-47fd-9021-1c7d97205dea,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='86e6b0501cb94028be07bddd2182638b',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf,updated_at=2022-09-30T09:48:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:27.096039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5cc647a5-0f9a-4048-b841-96c33fd32030 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e16146d2-6700-47fd-9021-1c7d97205dea), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:27.096742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5cc647a5-0f9a-4048-b841-96c33fd32030 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf'] Sep 30 09:48:27.346093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b95ac964-146c-4ed2-a930-1114a75fa10d tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:27Z,description='tempest-description--1890703283',id=282fb47d-342a-46a3-b176-f701ce385057,is_default=False,name='tempest-securitygroup--2041892264',project_id='f1c0948ddb014e6f93d6069bb5203890',revision_number=1,rules=[SecurityGroupRule(11680eeb-2c3d-44dd-b243-bc4d57c6a857),SecurityGroupRule(5f45f8b7-fbb9-41cd-9309-e820f7714180)],shared=False,stateful=True,updated_at=2022-09-30T09:48:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:27.346860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b95ac964-146c-4ed2-a930-1114a75fa10d tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (282fb47d-342a-46a3-b176-f701ce385057), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:27.347158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b95ac964-146c-4ed2-a930-1114a75fa10d tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:27Z,description=,direction='egress',ethertype='IPv4',id=11680eeb-2c3d-44dd-b243-bc4d57c6a857,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f1c0948ddb014e6f93d6069bb5203890',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=282fb47d-342a-46a3-b176-f701ce385057,updated_at=2022-09-30T09:48:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:27.347700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b95ac964-146c-4ed2-a930-1114a75fa10d tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (11680eeb-2c3d-44dd-b243-bc4d57c6a857), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:27.348033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b95ac964-146c-4ed2-a930-1114a75fa10d tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group rule updated ['282fb47d-342a-46a3-b176-f701ce385057'] Sep 30 09:48:27.348863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b95ac964-146c-4ed2-a930-1114a75fa10d tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:27Z,description=,direction='egress',ethertype='IPv6',id=5f45f8b7-fbb9-41cd-9309-e820f7714180,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f1c0948ddb014e6f93d6069bb5203890',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=282fb47d-342a-46a3-b176-f701ce385057,updated_at=2022-09-30T09:48:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:27.349209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b95ac964-146c-4ed2-a930-1114a75fa10d tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5f45f8b7-fbb9-41cd-9309-e820f7714180), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:27.349698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b95ac964-146c-4ed2-a930-1114a75fa10d tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group rule updated ['282fb47d-342a-46a3-b176-f701ce385057'] Sep 30 09:48:27.494153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f420a7d0-ff87-4d6b-a559-67dc3d9c4578 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:27Z,description='',direction='ingress',ethertype='IPv4',id=f1ef94f8-5e12-4bf8-806b-c9955a7ba8ff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf,updated_at=2022-09-30T09:48:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:27.494628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f420a7d0-ff87-4d6b-a559-67dc3d9c4578 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f1ef94f8-5e12-4bf8-806b-c9955a7ba8ff), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:27.495092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f420a7d0-ff87-4d6b-a559-67dc3d9c4578 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf'] Sep 30 09:48:27.806354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3a4471ca-d0aa-42bc-819d-a23c5b653815 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:27Z,description='',direction='ingress',ethertype='IPv4',id=3e59c42d-713b-4b60-8cd2-af1266337bb7,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f1c0948ddb014e6f93d6069bb5203890',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=282fb47d-342a-46a3-b176-f701ce385057,updated_at=2022-09-30T09:48:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:27.806767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3a4471ca-d0aa-42bc-819d-a23c5b653815 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (3e59c42d-713b-4b60-8cd2-af1266337bb7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:27.807114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3a4471ca-d0aa-42bc-819d-a23c5b653815 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group rule updated ['282fb47d-342a-46a3-b176-f701ce385057'] Sep 30 09:48:28.244822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3266f9eb-965b-4e7b-955c-a8dd443cf749 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:28Z,description='',direction='ingress',ethertype='IPv4',id=d5c79a47-8cc6-432e-a1cc-0556b3f93a38,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f1c0948ddb014e6f93d6069bb5203890',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=282fb47d-342a-46a3-b176-f701ce385057,updated_at=2022-09-30T09:48:28Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:28.245207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3266f9eb-965b-4e7b-955c-a8dd443cf749 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d5c79a47-8cc6-432e-a1cc-0556b3f93a38), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:28.248003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3266f9eb-965b-4e7b-955c-a8dd443cf749 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group rule updated ['282fb47d-342a-46a3-b176-f701ce385057'] Sep 30 09:48:28.327724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:327 started Sep 30 09:48:28.340497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c043a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=839000000,duration_sec=666,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:28.342529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:28.342915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:327 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 30 09:48:28.345288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cde9f341-70fe-4898-87a0-b5f537cf7363 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:27Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=1c9a8c50-f2c9-456a-9a09-dcb5f5b7fccc,mac_address=fa:16:3e:cf:cf:bf,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(1c9a8c50-f2c9-456a-9a09-dcb5f5b7fccc),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T09:48:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:28.345664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cde9f341-70fe-4898-87a0-b5f537cf7363 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (1c9a8c50-f2c9-456a-9a09-dcb5f5b7fccc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:28.818549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:28Z,description='Default security group',id=ab9087dc-ae4e-45dd-8a48-266c188cbf60,is_default=True,name='default',project_id='7e897f8836fe4715ab1b8ec5abf574d7',revision_number=1,rules=[SecurityGroupRule(522992f6-49c0-401e-9a96-083ae64e023f),SecurityGroupRule(5b17cffc-2a2d-4c4d-a460-645d1c76c56f),SecurityGroupRule(bf3d2988-ed5d-4452-b157-800be592ba1a),SecurityGroupRule(e1ea7980-8548-42c5-9d6f-4f60beee4f67)],shared=False,stateful=True,updated_at=2022-09-30T09:48:28Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:28.819268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (ab9087dc-ae4e-45dd-8a48-266c188cbf60), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:28.819852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:28Z,description=,direction='egress',ethertype='IPv4',id=522992f6-49c0-401e-9a96-083ae64e023f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e897f8836fe4715ab1b8ec5abf574d7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ab9087dc-ae4e-45dd-8a48-266c188cbf60,updated_at=2022-09-30T09:48:28Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:28.820210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (522992f6-49c0-401e-9a96-083ae64e023f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:28.820727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Security group rule updated ['ab9087dc-ae4e-45dd-8a48-266c188cbf60'] Sep 30 09:48:28.821559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:28Z,description=,direction='ingress',ethertype='IPv4',id=5b17cffc-2a2d-4c4d-a460-645d1c76c56f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e897f8836fe4715ab1b8ec5abf574d7',protocol=,remote_address_group_id=,remote_group_id=ab9087dc-ae4e-45dd-8a48-266c188cbf60,remote_ip_prefix=,revision_number=0,security_group_id=ab9087dc-ae4e-45dd-8a48-266c188cbf60,updated_at=2022-09-30T09:48:28Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:28.822086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5b17cffc-2a2d-4c4d-a460-645d1c76c56f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:28.822612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Security group rule updated ['ab9087dc-ae4e-45dd-8a48-266c188cbf60'] Sep 30 09:48:28.823508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:28Z,description=,direction='egress',ethertype='IPv6',id=bf3d2988-ed5d-4452-b157-800be592ba1a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e897f8836fe4715ab1b8ec5abf574d7',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ab9087dc-ae4e-45dd-8a48-266c188cbf60,updated_at=2022-09-30T09:48:28Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:28.824453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (bf3d2988-ed5d-4452-b157-800be592ba1a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:28.824946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Security group rule updated ['ab9087dc-ae4e-45dd-8a48-266c188cbf60'] Sep 30 09:48:28.825811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:28Z,description=,direction='ingress',ethertype='IPv6',id=e1ea7980-8548-42c5-9d6f-4f60beee4f67,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7e897f8836fe4715ab1b8ec5abf574d7',protocol=,remote_address_group_id=,remote_group_id=ab9087dc-ae4e-45dd-8a48-266c188cbf60,remote_ip_prefix=,revision_number=0,security_group_id=ab9087dc-ae4e-45dd-8a48-266c188cbf60,updated_at=2022-09-30T09:48:28Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:28.826341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e1ea7980-8548-42c5-9d6f-4f60beee4f67), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:28.826834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ecb31c79-57d4-46b7-84f4-3ff95233ffb4 admin admin] Security group rule updated ['ab9087dc-ae4e-45dd-8a48-266c188cbf60'] Sep 30 09:48:29.042100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Resource SecurityGroup deleted: ab9087dc-ae4e-45dd-8a48-266c188cbf60 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:29.042504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (ab9087dc-ae4e-45dd-8a48-266c188cbf60), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:29.043654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ab9087dc-ae4e-45dd-8a48-266c188cbf60',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:48:29.060072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ab9087dc-ae4e-45dd-8a48-266c188cbf60',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:48:29.060615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Resource SecurityGroupRule deleted: 522992f6-49c0-401e-9a96-083ae64e023f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:29.060986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (522992f6-49c0-401e-9a96-083ae64e023f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:29.063240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Security group rule updated ['ab9087dc-ae4e-45dd-8a48-266c188cbf60'] Sep 30 09:48:29.063240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Resource SecurityGroupRule deleted: 5b17cffc-2a2d-4c4d-a460-645d1c76c56f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:29.063240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5b17cffc-2a2d-4c4d-a460-645d1c76c56f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:29.063240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Security group rule updated ['ab9087dc-ae4e-45dd-8a48-266c188cbf60'] Sep 30 09:48:29.063240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Resource SecurityGroupRule deleted: bf3d2988-ed5d-4452-b157-800be592ba1a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:29.063938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (bf3d2988-ed5d-4452-b157-800be592ba1a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:29.063938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Security group rule updated ['ab9087dc-ae4e-45dd-8a48-266c188cbf60'] Sep 30 09:48:29.063938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Resource SecurityGroupRule deleted: e1ea7980-8548-42c5-9d6f-4f60beee4f67 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:29.064219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e1ea7980-8548-42c5-9d6f-4f60beee4f67), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:29.064411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6ab81dd8-f0a8-448f-a865-73afc492ac31 admin admin] Security group rule updated ['ab9087dc-ae4e-45dd-8a48-266c188cbf60'] Sep 30 09:48:29.173184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cde9f341-70fe-4898-87a0-b5f537cf7363 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource Port 1c9a8c50-f2c9-456a-9a09-dcb5f5b7fccc updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '81c2a910-de35-4fdd-9af0-16b18957017f'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:29.174243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cde9f341-70fe-4898-87a0-b5f537cf7363 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (1c9a8c50-f2c9-456a-9a09-dcb5f5b7fccc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:29.260260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-53089c72-d2d7-4139-88a4-d14e30d0900e tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:28Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=20848721-b1f2-4bdb-8d73-5b4e002189fa,mac_address=fa:16:3e:e9:c8:4f,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(20848721-b1f2-4bdb-8d73-5b4e002189fa),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T09:48:28Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:29.260695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-53089c72-d2d7-4139-88a4-d14e30d0900e tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (20848721-b1f2-4bdb-8d73-5b4e002189fa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:29.868205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-53089c72-d2d7-4139-88a4-d14e30d0900e tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Resource Port 20848721-b1f2-4bdb-8d73-5b4e002189fa updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'a4aa79c0-845f-4ad6-afb7-4e7e5b4446fe'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:29.868769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-53089c72-d2d7-4139-88a4-d14e30d0900e tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (20848721-b1f2-4bdb-8d73-5b4e002189fa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:30.327001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:328 started Sep 30 09:48:30.331674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c043c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=830000000,duration_sec=668,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:30.332326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:30.332671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:328 - starting polling. Elapsed:0.006 Sep 30 09:48:30.334976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:30.338136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:328 - port information retrieved. Elapsed:0.011 Sep 30 09:48:30.338472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:328 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 30 09:48:30.877414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:30Z,description='Default security group',id=678c2b98-c42e-4f11-8ae6-0d474af1da3e,is_default=True,name='default',project_id='1330031e214045bf9d45c73da1445255',revision_number=1,rules=[SecurityGroupRule(1162f1ba-0b0b-4739-a2c9-4fa2c56f595d),SecurityGroupRule(3a6d57f7-7f75-4381-8903-5bbadf1aa63b),SecurityGroupRule(5e36a194-734a-481b-93d5-9d57ebd6ed4f),SecurityGroupRule(a9b795a3-b5b4-47cb-9690-7b72e82b38b5)],shared=False,stateful=True,updated_at=2022-09-30T09:48:30Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:30.878023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (678c2b98-c42e-4f11-8ae6-0d474af1da3e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:30.878452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:30Z,description=,direction='egress',ethertype='IPv4',id=1162f1ba-0b0b-4739-a2c9-4fa2c56f595d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1330031e214045bf9d45c73da1445255',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=678c2b98-c42e-4f11-8ae6-0d474af1da3e,updated_at=2022-09-30T09:48:30Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:30.878869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (1162f1ba-0b0b-4739-a2c9-4fa2c56f595d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:30.879206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Security group rule updated ['678c2b98-c42e-4f11-8ae6-0d474af1da3e'] Sep 30 09:48:30.879932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:30Z,description=,direction='ingress',ethertype='IPv6',id=3a6d57f7-7f75-4381-8903-5bbadf1aa63b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1330031e214045bf9d45c73da1445255',protocol=,remote_address_group_id=,remote_group_id=678c2b98-c42e-4f11-8ae6-0d474af1da3e,remote_ip_prefix=,revision_number=0,security_group_id=678c2b98-c42e-4f11-8ae6-0d474af1da3e,updated_at=2022-09-30T09:48:30Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:30.880307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (3a6d57f7-7f75-4381-8903-5bbadf1aa63b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:30.880884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Security group rule updated ['678c2b98-c42e-4f11-8ae6-0d474af1da3e'] Sep 30 09:48:30.881642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:30Z,description=,direction='ingress',ethertype='IPv4',id=5e36a194-734a-481b-93d5-9d57ebd6ed4f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1330031e214045bf9d45c73da1445255',protocol=,remote_address_group_id=,remote_group_id=678c2b98-c42e-4f11-8ae6-0d474af1da3e,remote_ip_prefix=,revision_number=0,security_group_id=678c2b98-c42e-4f11-8ae6-0d474af1da3e,updated_at=2022-09-30T09:48:30Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:30.882051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5e36a194-734a-481b-93d5-9d57ebd6ed4f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:30.882387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Security group rule updated ['678c2b98-c42e-4f11-8ae6-0d474af1da3e'] Sep 30 09:48:30.884859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:30Z,description=,direction='egress',ethertype='IPv6',id=a9b795a3-b5b4-47cb-9690-7b72e82b38b5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1330031e214045bf9d45c73da1445255',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=678c2b98-c42e-4f11-8ae6-0d474af1da3e,updated_at=2022-09-30T09:48:30Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:30.887088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a9b795a3-b5b4-47cb-9690-7b72e82b38b5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:30.887461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Security group rule updated ['678c2b98-c42e-4f11-8ae6-0d474af1da3e'] Sep 30 09:48:31.209256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:48:30Z,description='',dns_domain=None,id=66e518e7-6dfd-46cc-b9d0-1baf366ca8b7,mtu=1500,name='tempest-TestShelveInstance-1871820373-network',project_id='1330031e214045bf9d45c73da1445255',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(66e518e7-6dfd-46cc-b9d0-1baf366ca8b7),segments=[NetworkSegment(5a960c0a-e5d4-4995-ad68-d03963036798)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:48:30Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:31.209801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (66e518e7-6dfd-46cc-b9d0-1baf366ca8b7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:31.312346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-0e063636-74d4-4e54-9ca8-caa7a8918545 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 66e518e7-6dfd-46cc-b9d0-1baf366ca8b7 with segmentation id not found. Sep 30 09:48:31.312346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:48:31.312346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:48:31.312346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:48:31.312346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:48:31.312346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:48:31.312346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:48:31.312346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:48:31.312346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:48:31.312346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:48:31.312346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:48:31.312346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:48:31.312346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:48:31.313551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:48:31.313551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:48:31.313551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:48:31.313551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 66e518e7-6dfd-46cc-b9d0-1baf366ca8b7 with segmentation id not found. Sep 30 09:48:31.313551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:48:31.646285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1b5f2dcc-2435-43c0-bb54-38c42cfb575b tempest-VolumesActionsTest-1876305362 tempest-VolumesActionsTest-1876305362-project] Resource Port deleted: 789f9272-6c06-496f-83bd-184cd3013e84 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:31.653724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1b5f2dcc-2435-43c0-bb54-38c42cfb575b tempest-VolumesActionsTest-1876305362 tempest-VolumesActionsTest-1876305362-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (789f9272-6c06-496f-83bd-184cd3013e84), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:31.655376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1b5f2dcc-2435-43c0-bb54-38c42cfb575b tempest-VolumesActionsTest-1876305362 tempest-VolumesActionsTest-1876305362-project] Security group member updated {'35fe4fab-f7e7-497f-b77d-71379dee8053'} Sep 30 09:48:31.967139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f46ace11-8e05-4267-9248-b0659d61cd9c admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(3a5bed84-eb0d-4744-ab6d-b658b5e2a302)],cidr=172.20.0.0/28,created_at=2022-09-30T09:48:31Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=6f26d679-c954-4e46-831c-7bd0a36da165,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-1871820373-subnet',network_id=66e518e7-6dfd-46cc-b9d0-1baf366ca8b7,project_id='1330031e214045bf9d45c73da1445255',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:48:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:31.968575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f46ace11-8e05-4267-9248-b0659d61cd9c admin admin] Publish callbacks [] for Subnet (6f26d679-c954-4e46-831c-7bd0a36da165), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:32.042948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:31Z,description='Default security group',id=968c2920-4fcd-439f-a381-e1ac75b8e14f,is_default=True,name='default',project_id='3aced3101122427ebab228330526aaca',revision_number=1,rules=[SecurityGroupRule(114325c3-b24a-4c8d-9f01-03090f8e29ff),SecurityGroupRule(73dd91f4-7d4f-43de-8130-a02dc1546e33),SecurityGroupRule(bd69af95-e72c-42e2-b6cd-036a1a7fab7f),SecurityGroupRule(c9dbbd00-7692-4a8f-ae01-b51b540ad0f2)],shared=False,stateful=True,updated_at=2022-09-30T09:48:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:32.043534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (968c2920-4fcd-439f-a381-e1ac75b8e14f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:32.044584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:31Z,description=,direction='ingress',ethertype='IPv6',id=114325c3-b24a-4c8d-9f01-03090f8e29ff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3aced3101122427ebab228330526aaca',protocol=,remote_address_group_id=,remote_group_id=968c2920-4fcd-439f-a381-e1ac75b8e14f,remote_ip_prefix=,revision_number=0,security_group_id=968c2920-4fcd-439f-a381-e1ac75b8e14f,updated_at=2022-09-30T09:48:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:32.045216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (114325c3-b24a-4c8d-9f01-03090f8e29ff), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:32.045555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Security group rule updated ['968c2920-4fcd-439f-a381-e1ac75b8e14f'] Sep 30 09:48:32.046237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:31Z,description=,direction='ingress',ethertype='IPv4',id=73dd91f4-7d4f-43de-8130-a02dc1546e33,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3aced3101122427ebab228330526aaca',protocol=,remote_address_group_id=,remote_group_id=968c2920-4fcd-439f-a381-e1ac75b8e14f,remote_ip_prefix=,revision_number=0,security_group_id=968c2920-4fcd-439f-a381-e1ac75b8e14f,updated_at=2022-09-30T09:48:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:32.046611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (73dd91f4-7d4f-43de-8130-a02dc1546e33), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:32.047218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Security group rule updated ['968c2920-4fcd-439f-a381-e1ac75b8e14f'] Sep 30 09:48:32.048378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:31Z,description=,direction='egress',ethertype='IPv6',id=bd69af95-e72c-42e2-b6cd-036a1a7fab7f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3aced3101122427ebab228330526aaca',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=968c2920-4fcd-439f-a381-e1ac75b8e14f,updated_at=2022-09-30T09:48:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:32.048734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (bd69af95-e72c-42e2-b6cd-036a1a7fab7f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:32.049059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Security group rule updated ['968c2920-4fcd-439f-a381-e1ac75b8e14f'] Sep 30 09:48:32.050356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:31Z,description=,direction='egress',ethertype='IPv4',id=c9dbbd00-7692-4a8f-ae01-b51b540ad0f2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3aced3101122427ebab228330526aaca',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=968c2920-4fcd-439f-a381-e1ac75b8e14f,updated_at=2022-09-30T09:48:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:32.051256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c9dbbd00-7692-4a8f-ae01-b51b540ad0f2), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:32.051596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5947b921-92ef-4450-9b6b-1856dcb09abe admin admin] Security group rule updated ['968c2920-4fcd-439f-a381-e1ac75b8e14f'] Sep 30 09:48:32.311649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Resource SecurityGroup deleted: 968c2920-4fcd-439f-a381-e1ac75b8e14f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:32.312027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (968c2920-4fcd-439f-a381-e1ac75b8e14f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:32.312492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('968c2920-4fcd-439f-a381-e1ac75b8e14f',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:48:32.328177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:329 started Sep 30 09:48:32.333284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c043e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=831000000,duration_sec=670,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:32.335150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:32.335725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:329 - starting polling. Elapsed:0.008 Sep 30 09:48:32.339000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:32.340797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 789f9272-6c06-496f-83bd-184cd3013e84 not present in bridge br-int Sep 30 09:48:32.342141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:48:32.343451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['789f9272-6c06-496f-83bd-184cd3013e84'] Sep 30 09:48:32.344747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 789f9272-6c06-496f-83bd-184cd3013e84 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:48:32.350387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:329 - port information retrieved. Elapsed:0.022 Sep 30 09:48:32.350998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:329 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.023 Sep 30 09:48:32.351745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('968c2920-4fcd-439f-a381-e1ac75b8e14f',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:48:32.352466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Resource SecurityGroupRule deleted: 114325c3-b24a-4c8d-9f01-03090f8e29ff {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:32.352932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (114325c3-b24a-4c8d-9f01-03090f8e29ff), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:32.353381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Security group rule updated ['968c2920-4fcd-439f-a381-e1ac75b8e14f'] Sep 30 09:48:32.353865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Resource SecurityGroupRule deleted: 73dd91f4-7d4f-43de-8130-a02dc1546e33 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:32.356128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (73dd91f4-7d4f-43de-8130-a02dc1546e33), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:32.356697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Security group rule updated ['968c2920-4fcd-439f-a381-e1ac75b8e14f'] Sep 30 09:48:32.357412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Resource SecurityGroupRule deleted: bd69af95-e72c-42e2-b6cd-036a1a7fab7f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:32.357966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (bd69af95-e72c-42e2-b6cd-036a1a7fab7f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:32.358684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Security group rule updated ['968c2920-4fcd-439f-a381-e1ac75b8e14f'] Sep 30 09:48:32.359265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Resource SecurityGroupRule deleted: c9dbbd00-7692-4a8f-ae01-b51b540ad0f2 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:32.359813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c9dbbd00-7692-4a8f-ae01-b51b540ad0f2), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:32.360549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c3ea40df-c389-46cb-a6ea-3fe57aa0a36c admin admin] Security group rule updated ['968c2920-4fcd-439f-a381-e1ac75b8e14f'] Sep 30 09:48:33.119394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-20712f89-659a-4cac-8382-93398774ab60 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:32Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-66e518e7-6dfd-46cc-b9d0-1baf366ca8b7',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=94897731-51b0-456e-b633-f954a65edcca,mac_address=fa:16:3e:11:73:97,name='',network_id=66e518e7-6dfd-46cc-b9d0-1baf366ca8b7,numa_affinity_policy=,project_id='1330031e214045bf9d45c73da1445255',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(94897731-51b0-456e-b633-f954a65edcca),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:48:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:33.121127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-20712f89-659a-4cac-8382-93398774ab60 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (94897731-51b0-456e-b633-f954a65edcca), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:33.692074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c56c1aca-cfc1-4450-ae4c-4f571bcea28d tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:32Z,data_plane_status=None,description='',device_id='35cb36cf-5501-4cf6-8a17-c988d7a0e337',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3,mac_address=fa:16:3e:f5:0a:bd,name='',network_id=5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7,numa_affinity_policy=,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3),security_group_ids=set([486454ec-5304-4b26-ac0e-18fa2421327c]),status='DOWN',updated_at=2022-09-30T09:48:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:33.692218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c56c1aca-cfc1-4450-ae4c-4f571bcea28d tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:33.692632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c56c1aca-cfc1-4450-ae4c-4f571bcea28d tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group member updated {'486454ec-5304-4b26-ac0e-18fa2421327c'} Sep 30 09:48:33.935170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-20712f89-659a-4cac-8382-93398774ab60 None None] Resource Port 94897731-51b0-456e-b633-f954a65edcca updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=94897731-51b0-456e-b633-f954a65edcca,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=94897731-51b0-456e-b633-f954a65edcca,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=94897731-51b0-456e-b633-f954a65edcca,segment=NetworkSegment(5a960c0a-e5d4-4995-ad68-d03963036798),segment_id=5a960c0a-e5d4-4995-ad68-d03963036798)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:33.935170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-20712f89-659a-4cac-8382-93398774ab60 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (94897731-51b0-456e-b633-f954a65edcca), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:34.126710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5aab9120-3b9e-4768-b20d-e0151fd41c04","insert","tap94897731-51",["set",[]],["map",[["attached-mac","fa:16:3e:11:73:97"],["iface-id","94897731-51b0-456e-b633-f954a65edcca"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:34.160057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5aab9120-3b9e-4768-b20d-e0151fd41c04","old",null,["set",[]],null],["","new","tap94897731-51",21,["map",[["attached-mac","fa:16:3e:11:73:97"],["iface-id","94897731-51b0-456e-b633-f954a65edcca"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:34.329465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:330 started Sep 30 09:48:34.333069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0440,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=832000000,duration_sec=672,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:34.334039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:34.334860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:330 - starting polling. Elapsed:0.006 Sep 30 09:48:34.338292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:34.351629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:330 - port information retrieved. Elapsed:0.019 Sep 30 09:48:34.352114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': {'94897731-51b0-456e-b633-f954a65edcca'}, 'removed': set(), 'updated': {'94897731-51b0-456e-b633-f954a65edcca'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:34.352757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '94897731-51b0-456e-b633-f954a65edcca', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-66e518e7-6dfd-46cc-b9d0-1baf366ca8b7', 'network_id': '66e518e7-6dfd-46cc-b9d0-1baf366ca8b7', 'port_id': '94897731-51b0-456e-b633-f954a65edcca', 'mac_address': 'fa:16:3e:11:73:97', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f26d679-c954-4e46-831c-7bd0a36da165', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:34.358419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 94897731-51b0-456e-b633-f954a65edcca {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:34.359106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 94897731-51b0-456e-b633-f954a65edcca updated. Details: {'device': '94897731-51b0-456e-b633-f954a65edcca', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-66e518e7-6dfd-46cc-b9d0-1baf366ca8b7', 'network_id': '66e518e7-6dfd-46cc-b9d0-1baf366ca8b7', 'port_id': '94897731-51b0-456e-b633-f954a65edcca', 'mac_address': 'fa:16:3e:11:73:97', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f26d679-c954-4e46-831c-7bd0a36da165', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:48:34.359635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 9 as local vlan for net-id=66e518e7-6dfd-46cc-b9d0-1baf366ca8b7, seg-id=381 Sep 30 09:48:34.364025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xc9105ef6,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4477), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:34.367708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xf1c0442,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4105)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4477}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:34.368916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap94897731-51, col_values=(('tag', 9),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:34.369504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap94897731-51, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:34.370102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap94897731-51, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:34.378442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap94897731-51, col_values=(('other_config', {'net_uuid': '66e518e7-6dfd-46cc-b9d0-1baf366ca8b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '381'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:34.403705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0444,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:34.408127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:330 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.052 Sep 30 09:48:34.408906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:48:34.411307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'94897731-51b0-456e-b633-f954a65edcca'} Sep 30 09:48:34.412115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:34.413442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:34.422627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:34.503797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b9c3a20a-3feb-4d1e-b428-8c45ae1f94d3 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:33Z,data_plane_status=None,description='',device_id='37948e78-e1ec-4aee-815b-077ddf094735',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6,mac_address=fa:16:3e:af:aa:77,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:48:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:34.504189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b9c3a20a-3feb-4d1e-b428-8c45ae1f94d3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:34.549105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06a11d2-4203-43dd-9dcc-bdbdabcf4087]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:34.559046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:330 - agent port security group processed in 0.198 Sep 30 09:48:34.560021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 94897731-51b0-456e-b633-f954a65edcca to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:35.263693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['94897731-51b0-456e-b633-f954a65edcca'] and devices down [] completed. Sep 30 09:48:35.264395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:330 - ports processed. Elapsed:0.935 Sep 30 09:48:35.264395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:330 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.935 Sep 30 09:48:35.582235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port 94897731-51b0-456e-b633-f954a65edcca updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:35.582810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (94897731-51b0-456e-b633-f954a65edcca), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:35.723456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-78668062-f527-45c4-840b-621de3124057 service neutron] Resource Port 4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:35.724154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-78668062-f527-45c4-840b-621de3124057 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:36.330346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:331 started Sep 30 09:48:36.332945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0446,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=833000000,duration_sec=674,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:36.333550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:36.333969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:331 - starting polling. Elapsed:0.004 Sep 30 09:48:36.338841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:36.355979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:331 - port information retrieved. Elapsed:0.026 Sep 30 09:48:36.356411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': set(), 'removed': set(), 'updated': {'94897731-51b0-456e-b633-f954a65edcca'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:36.356921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '94897731-51b0-456e-b633-f954a65edcca', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-66e518e7-6dfd-46cc-b9d0-1baf366ca8b7', 'network_id': '66e518e7-6dfd-46cc-b9d0-1baf366ca8b7', 'port_id': '94897731-51b0-456e-b633-f954a65edcca', 'mac_address': 'fa:16:3e:11:73:97', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f26d679-c954-4e46-831c-7bd0a36da165', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:36.374484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 94897731-51b0-456e-b633-f954a65edcca {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:36.375316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 94897731-51b0-456e-b633-f954a65edcca updated. Details: {'device': '94897731-51b0-456e-b633-f954a65edcca', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-66e518e7-6dfd-46cc-b9d0-1baf366ca8b7', 'network_id': '66e518e7-6dfd-46cc-b9d0-1baf366ca8b7', 'port_id': '94897731-51b0-456e-b633-f954a65edcca', 'mac_address': 'fa:16:3e:11:73:97', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f26d679-c954-4e46-831c-7bd0a36da165', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Sep 30 09:48:36.377817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap94897731-51, col_values=(('tag', 9),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:36.378439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap94897731-51, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:36.379040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap94897731-51, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:36.379907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:36.416486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-78668062-f527-45c4-840b-621de3124057 service neutron] Resource Port 4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3,segment=NetworkSegment(9721804e-7351-4e77-b7b7-263929da43a3),segment_id=9721804e-7351-4e77-b7b7-263929da43a3)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:36.416887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-78668062-f527-45c4-840b-621de3124057 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:36.417798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap94897731-51, col_values=(('other_config', {'net_uuid': '66e518e7-6dfd-46cc-b9d0-1baf366ca8b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '381', 'tag': '9'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:36.428842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:36.443095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0448,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:36.444389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:331 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.087 Sep 30 09:48:36.444389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:48:36.444389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:48:36.450750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:36.451021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:36.459802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:36.578260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[467e6373-3fd3-4ea8-af1a-84b385009d71]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:36.578777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:331 - agent port security group processed in 0.222 Sep 30 09:48:36.579723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 94897731-51b0-456e-b633-f954a65edcca to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:37.133847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['94897731-51b0-456e-b633-f954a65edcca'] and devices down [] completed. Sep 30 09:48:37.134626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:331 - ports processed. Elapsed:0.804 Sep 30 09:48:37.135170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:331 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.805 Sep 30 09:48:38.157946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1c122395-a4bc-450f-9240-4715797225b1 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:37Z,data_plane_status=None,description='',device_id='37948e78-e1ec-4aee-815b-077ddf094735',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6becbba2-d82d-4e76-9a4a-a17dc48fbef1,mac_address=fa:16:3e:75:89:a1,name='',network_id=66e518e7-6dfd-46cc-b9d0-1baf366ca8b7,numa_affinity_policy=,project_id='1330031e214045bf9d45c73da1445255',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6becbba2-d82d-4e76-9a4a-a17dc48fbef1),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:48:37Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:38.157946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1c122395-a4bc-450f-9240-4715797225b1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6becbba2-d82d-4e76-9a4a-a17dc48fbef1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:38.218539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cb40f4d8-5970-4190-bb95-f182362ab4c6 None None] Resource Port c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:38.219247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cb40f4d8-5970-4190-bb95-f182362ab4c6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:38.331952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:332 started Sep 30 09:48:38.335001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c044a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=835000000,duration_sec=676,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:38.335777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:38.336374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:332 - starting polling. Elapsed:0.005 Sep 30 09:48:38.340267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:38.347534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:332 - port information retrieved. Elapsed:0.016 Sep 30 09:48:38.347870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:332 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 30 09:48:38.746543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cb40f4d8-5970-4190-bb95-f182362ab4c6 None None] Resource Port c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:38.747321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cb40f4d8-5970-4190-bb95-f182362ab4c6 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:39.046038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1c122395-a4bc-450f-9240-4715797225b1 admin admin] Received resource Port update without any changes: 6becbba2-d82d-4e76-9a4a-a17dc48fbef1 {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 30 09:48:39.722013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-127a4acf-d3bc-4b51-97de-ec2bfaa24390 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:38Z,data_plane_status=None,description='',device_id='44e7298b-38f3-436b-98ed-e9157faaca5e',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=411b31d5-4a9b-44b2-8ce8-22d9cb075ef9,mac_address=fa:16:3e:5e:1c:d5,name='',network_id=069f8527-f158-4f06-809a-7a507bf3fc84,numa_affinity_policy=,project_id='f1c0948ddb014e6f93d6069bb5203890',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(411b31d5-4a9b-44b2-8ce8-22d9cb075ef9),security_group_ids=set([282fb47d-342a-46a3-b176-f701ce385057]),status='DOWN',updated_at=2022-09-30T09:48:38Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:39.723337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-127a4acf-d3bc-4b51-97de-ec2bfaa24390 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (411b31d5-4a9b-44b2-8ce8-22d9cb075ef9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:39.724048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-127a4acf-d3bc-4b51-97de-ec2bfaa24390 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group member updated {'282fb47d-342a-46a3-b176-f701ce385057'} Sep 30 09:48:39.732645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9076636a-4694-4e8a-8920-e087f25c2f86","insert","qr-6becbba2-d8",["set",[]],["map",[["attached-mac","fa:16:3e:75:89:a1"],["iface-id","6becbba2-d82d-4e76-9a4a-a17dc48fbef1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:39.755590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9076636a-4694-4e8a-8920-e087f25c2f86","old",null,["set",[]],null],["","new","qr-6becbba2-d8",22,["map",[["attached-mac","fa:16:3e:75:89:a1"],["iface-id","6becbba2-d82d-4e76-9a4a-a17dc48fbef1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:40.332562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:333 started Sep 30 09:48:40.335538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c044c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=835000000,duration_sec=678,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:40.336184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:40.336834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:333 - starting polling. Elapsed:0.004 Sep 30 09:48:40.340229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:40.351468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:333 - port information retrieved. Elapsed:0.012 Sep 30 09:48:40.352060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': {'6becbba2-d82d-4e76-9a4a-a17dc48fbef1'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:40.352922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: WARNING neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:37Z,data_plane_status=None,description='',device_id='37948e78-e1ec-4aee-815b-077ddf094735',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6becbba2-d82d-4e76-9a4a-a17dc48fbef1,mac_address=fa:16:3e:75:89:a1,name='',network_id=66e518e7-6dfd-46cc-b9d0-1baf366ca8b7,numa_affinity_policy=,project_id='1330031e214045bf9d45c73da1445255',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(6becbba2-d82d-4e76-9a4a-a17dc48fbef1),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:48:38Z) is not bound. Sep 30 09:48:40.374439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 6becbba2-d82d-4e76-9a4a-a17dc48fbef1 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:40.374766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Device 6becbba2-d82d-4e76-9a4a-a17dc48fbef1 not defined on plugin or binding failed Sep 30 09:48:40.377496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:333 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 18 devices currently available. Time elapsed: 0.025 Sep 30 09:48:40.379055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:48:40.383657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'6becbba2-d82d-4e76-9a4a-a17dc48fbef1'} Sep 30 09:48:40.386706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:40.387830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:40.403215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:333 - agent port security group processed in 0.050 Sep 30 09:48:40.407039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:48:40.416201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:333 - ports processed. Elapsed:0.075 Sep 30 09:48:40.416201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:333 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.076 Sep 30 09:48:40.486570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-fba0b17a-aa18-4313-9dc0-2ef1fb534eaa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:37Z,data_plane_status=None,description='',device_id='59975d37-8db0-4019-9303-88b12ef029ed',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b4db42a3-b3ea-4c10-8fa2-c3c219dd729e,mac_address=fa:16:3e:ba:0d:1e,name='',network_id=d038a068-f643-497f-8e6f-7d6e8fb5892b,numa_affinity_policy=,project_id='86e6b0501cb94028be07bddd2182638b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b4db42a3-b3ea-4c10-8fa2-c3c219dd729e),security_group_ids=set([47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf]),status='DOWN',updated_at=2022-09-30T09:48:38Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:40.487159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-fba0b17a-aa18-4313-9dc0-2ef1fb534eaa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (b4db42a3-b3ea-4c10-8fa2-c3c219dd729e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:40.487754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-fba0b17a-aa18-4313-9dc0-2ef1fb534eaa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group member updated {'47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf'} Sep 30 09:48:40.735950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d73ab5b1-8cc7-4def-bbb2-3c9433c49b7b","insert","qg-c3b02e0e-6a",["set",[]],["map",[["attached-mac","fa:16:3e:af:aa:77"],["iface-id","c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:40.754187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d73ab5b1-8cc7-4def-bbb2-3c9433c49b7b","old",null,["set",[]],null],["","new","qg-c3b02e0e-6a",23,["map",[["attached-mac","fa:16:3e:af:aa:77"],["iface-id","c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:41.314244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-092c3cc0-5fc0-4735-b08f-c1fe17f8b52e service neutron] Resource Port 411b31d5-4a9b-44b2-8ce8-22d9cb075ef9 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=411b31d5-4a9b-44b2-8ce8-22d9cb075ef9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=411b31d5-4a9b-44b2-8ce8-22d9cb075ef9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:41.315016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-092c3cc0-5fc0-4735-b08f-c1fe17f8b52e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (411b31d5-4a9b-44b2-8ce8-22d9cb075ef9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:42.185575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-092c3cc0-5fc0-4735-b08f-c1fe17f8b52e service neutron] Resource Port 411b31d5-4a9b-44b2-8ce8-22d9cb075ef9 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=411b31d5-4a9b-44b2-8ce8-22d9cb075ef9,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=411b31d5-4a9b-44b2-8ce8-22d9cb075ef9,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=411b31d5-4a9b-44b2-8ce8-22d9cb075ef9,segment=NetworkSegment(fc32f094-22aa-44bb-9338-b364f7aad433),segment_id=fc32f094-22aa-44bb-9338-b364f7aad433)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:42.190096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-092c3cc0-5fc0-4735-b08f-c1fe17f8b52e service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (411b31d5-4a9b-44b2-8ce8-22d9cb075ef9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:42.333285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:334 started Sep 30 09:48:42.336596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c044e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=836000000,duration_sec=680,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:42.337556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:42.338071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:334 - starting polling. Elapsed:0.005 Sep 30 09:48:42.341889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:42.345590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:334 - port information retrieved. Elapsed:0.012 Sep 30 09:48:42.349316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': {'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:42.351058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', 'device_id': '37948e78-e1ec-4aee-815b-077ddf094735', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', 'mac_address': 'fa:16:3e:af:aa:77', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.74'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:42.362468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:42.363091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6 updated. Details: {'device': 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', 'device_id': '37948e78-e1ec-4aee-815b-077ddf094735', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', 'mac_address': 'fa:16:3e:af:aa:77', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.74'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:48:42.364478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c3b02e0e-6a, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:42.365090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-c3b02e0e-6a, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:42.366017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-c3b02e0e-6a, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:42.380960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c3b02e0e-6a, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:42.406684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0450,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:42.407282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:334 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.057 Sep 30 09:48:42.407639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:48:42.407934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6'} Sep 30 09:48:42.409207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:42.411331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:42.418966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:42.496634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4524691b-18ca-44cd-ae72-cc263fb60259]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:42.498292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:334 - agent port security group processed in 0.148 Sep 30 09:48:42.501027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:42.952898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6'] and devices down [] completed. Sep 30 09:48:42.953521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:334 - ports processed. Elapsed:0.620 Sep 30 09:48:42.954039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:334 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.621 Sep 30 09:48:43.066537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:43.067228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:43.464900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6219a3c7-cbe9-472d-9707-e4ca0ca612c5 service neutron] Resource Port b4db42a3-b3ea-4c10-8fa2-c3c219dd729e updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=b4db42a3-b3ea-4c10-8fa2-c3c219dd729e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=b4db42a3-b3ea-4c10-8fa2-c3c219dd729e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:43.465549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6219a3c7-cbe9-472d-9707-e4ca0ca612c5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (b4db42a3-b3ea-4c10-8fa2-c3c219dd729e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:43.470040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:43Z,description='Default security group',id=29ade661-fd3d-44f0-8558-9190e721e633,is_default=True,name='default',project_id='82b48c489465430a836de26d4aa39440',revision_number=1,rules=[SecurityGroupRule(05c6d347-8e98-4b80-bbcd-7b7c0ca398e4),SecurityGroupRule(4ac29be5-d48e-4656-86af-eaa45b659f8c),SecurityGroupRule(e57acd40-abcc-4ffe-b902-5e40262e5750),SecurityGroupRule(f661d7bd-453a-48d4-84bf-8932966f3f31)],shared=False,stateful=True,updated_at=2022-09-30T09:48:43Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:43.473586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (29ade661-fd3d-44f0-8558-9190e721e633), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:43.474774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:43Z,description=,direction='egress',ethertype='IPv6',id=05c6d347-8e98-4b80-bbcd-7b7c0ca398e4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='82b48c489465430a836de26d4aa39440',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=29ade661-fd3d-44f0-8558-9190e721e633,updated_at=2022-09-30T09:48:43Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:43.475750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (05c6d347-8e98-4b80-bbcd-7b7c0ca398e4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:43.476125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Security group rule updated ['29ade661-fd3d-44f0-8558-9190e721e633'] Sep 30 09:48:43.477000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:43Z,description=,direction='ingress',ethertype='IPv4',id=4ac29be5-d48e-4656-86af-eaa45b659f8c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='82b48c489465430a836de26d4aa39440',protocol=,remote_address_group_id=,remote_group_id=29ade661-fd3d-44f0-8558-9190e721e633,remote_ip_prefix=,revision_number=0,security_group_id=29ade661-fd3d-44f0-8558-9190e721e633,updated_at=2022-09-30T09:48:43Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:43.477430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4ac29be5-d48e-4656-86af-eaa45b659f8c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:43.477771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Security group rule updated ['29ade661-fd3d-44f0-8558-9190e721e633'] Sep 30 09:48:43.478531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:43Z,description=,direction='ingress',ethertype='IPv6',id=e57acd40-abcc-4ffe-b902-5e40262e5750,normalized_cidr=None,port_range_max=,port_range_min=,project_id='82b48c489465430a836de26d4aa39440',protocol=,remote_address_group_id=,remote_group_id=29ade661-fd3d-44f0-8558-9190e721e633,remote_ip_prefix=,revision_number=0,security_group_id=29ade661-fd3d-44f0-8558-9190e721e633,updated_at=2022-09-30T09:48:43Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:43.479103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e57acd40-abcc-4ffe-b902-5e40262e5750), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:43.480074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Security group rule updated ['29ade661-fd3d-44f0-8558-9190e721e633'] Sep 30 09:48:43.488563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:43Z,description=,direction='egress',ethertype='IPv4',id=f661d7bd-453a-48d4-84bf-8932966f3f31,normalized_cidr=None,port_range_max=,port_range_min=,project_id='82b48c489465430a836de26d4aa39440',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=29ade661-fd3d-44f0-8558-9190e721e633,updated_at=2022-09-30T09:48:43Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:43.491304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f661d7bd-453a-48d4-84bf-8932966f3f31), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:43.491854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Security group rule updated ['29ade661-fd3d-44f0-8558-9190e721e633'] Sep 30 09:48:44.062655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:48:43Z,description='',dns_domain=None,id=a62b74a3-1997-4c61-bbde-a23d7b16ffe0,mtu=1500,name='tempest-TestShelveInstance-236201644-network',project_id='82b48c489465430a836de26d4aa39440',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(a62b74a3-1997-4c61-bbde-a23d7b16ffe0),segments=[NetworkSegment(20943992-40cd-4c03-a0f9-331f0f5fa72a)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:48:43Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:44.063307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (a62b74a3-1997-4c61-bbde-a23d7b16ffe0), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:44.438689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-4b37c855-70f2-4489-a8bf-c2b07a710a35 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network a62b74a3-1997-4c61-bbde-a23d7b16ffe0 with segmentation id not found. Sep 30 09:48:44.438689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:48:44.438689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:48:44.438689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:48:44.438689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:48:44.438689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:48:44.438689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:48:44.438689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:48:44.438689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:48:44.438689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:48:44.438689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:48:44.438689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:48:44.438689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:48:44.440515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:48:44.440515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:48:44.440515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:48:44.440515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network a62b74a3-1997-4c61-bbde-a23d7b16ffe0 with segmentation id not found. Sep 30 09:48:44.440515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:48:44.440515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:335 started Sep 30 09:48:44.440515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0452,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=836000000,duration_sec=682,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:44.442401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:44.442401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:335 - starting polling. Elapsed:0.005 Sep 30 09:48:44.442401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:44.442401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:335 - port information retrieved. Elapsed:0.013 Sep 30 09:48:44.447416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': set(), 'removed': set(), 'updated': {'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:44.447875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', 'device_id': '37948e78-e1ec-4aee-815b-077ddf094735', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', 'mac_address': 'fa:16:3e:af:aa:77', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.74'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:44.447875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:44.448801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6 updated. Details: {'device': 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', 'device_id': '37948e78-e1ec-4aee-815b-077ddf094735', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', 'mac_address': 'fa:16:3e:af:aa:77', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.74'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:48:44.448801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c3b02e0e-6a, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:44.448801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-c3b02e0e-6a, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:44.448801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-c3b02e0e-6a, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:44.449508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:44.449508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-c3b02e0e-6a, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:44.449508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:44.449508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0454,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:44.449508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:335 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.043 Sep 30 09:48:44.451828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:48:44.451828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:48:44.451828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:44.451828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:44.451828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:44.492123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[88db88a8-66d5-4473-a164-c20075dc14d3]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:44.492814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:335 - agent port security group processed in 0.143 Sep 30 09:48:44.493555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:44.835761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6'] and devices down [] completed. Sep 30 09:48:44.836336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:335 - ports processed. Elapsed:0.502 Sep 30 09:48:44.836843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:335 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.503 Sep 30 09:48:44.921902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ae1f650-fb77-48fa-a9c9-c5d4bd0dc3e1 None None] Resource Port 6becbba2-d82d-4e76-9a4a-a17dc48fbef1 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=6becbba2-d82d-4e76-9a4a-a17dc48fbef1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6becbba2-d82d-4e76-9a4a-a17dc48fbef1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:44.928841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3ae1f650-fb77-48fa-a9c9-c5d4bd0dc3e1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6becbba2-d82d-4e76-9a4a-a17dc48fbef1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:45.112814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6219a3c7-cbe9-472d-9707-e4ca0ca612c5 service neutron] Resource Port b4db42a3-b3ea-4c10-8fa2-c3c219dd729e updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=b4db42a3-b3ea-4c10-8fa2-c3c219dd729e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=b4db42a3-b3ea-4c10-8fa2-c3c219dd729e,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=b4db42a3-b3ea-4c10-8fa2-c3c219dd729e,segment=NetworkSegment(e6b17fb5-eb11-41c5-b8ac-1188c97e0520),segment_id=e6b17fb5-eb11-41c5-b8ac-1188c97e0520)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:45.118152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6219a3c7-cbe9-472d-9707-e4ca0ca612c5 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (b4db42a3-b3ea-4c10-8fa2-c3c219dd729e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:45.412651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ae1f650-fb77-48fa-a9c9-c5d4bd0dc3e1 None None] Resource Port 6becbba2-d82d-4e76-9a4a-a17dc48fbef1 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6becbba2-d82d-4e76-9a4a-a17dc48fbef1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6becbba2-d82d-4e76-9a4a-a17dc48fbef1,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6becbba2-d82d-4e76-9a4a-a17dc48fbef1,segment=NetworkSegment(5a960c0a-e5d4-4995-ad68-d03963036798),segment_id=5a960c0a-e5d4-4995-ad68-d03963036798)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:45.413229 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3ae1f650-fb77-48fa-a9c9-c5d4bd0dc3e1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6becbba2-d82d-4e76-9a4a-a17dc48fbef1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:45.446191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:45Z,description='Default security group',id=999e6db3-6caa-46cb-a505-33827a011de7,is_default=True,name='default',project_id='068a17bb811448d28e4ba1907f47b8a1',revision_number=1,rules=[SecurityGroupRule(0a56eaca-f8c4-45f9-b6e2-4de3284a0ede),SecurityGroupRule(0caf1147-8773-47cc-9a54-d5c341533620),SecurityGroupRule(62903ea6-311c-47d8-b88d-d1d6d2b6c18e),SecurityGroupRule(fadc32da-79f4-477c-89aa-a4ada2a0fb5d)],shared=False,stateful=True,updated_at=2022-09-30T09:48:45Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:45.446990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (999e6db3-6caa-46cb-a505-33827a011de7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:45.447853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:45Z,description=,direction='egress',ethertype='IPv6',id=0a56eaca-f8c4-45f9-b6e2-4de3284a0ede,normalized_cidr=None,port_range_max=,port_range_min=,project_id='068a17bb811448d28e4ba1907f47b8a1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=999e6db3-6caa-46cb-a505-33827a011de7,updated_at=2022-09-30T09:48:45Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:45.448733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (0a56eaca-f8c4-45f9-b6e2-4de3284a0ede), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:45.449644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Security group rule updated ['999e6db3-6caa-46cb-a505-33827a011de7'] Sep 30 09:48:45.450553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:45Z,description=,direction='ingress',ethertype='IPv6',id=0caf1147-8773-47cc-9a54-d5c341533620,normalized_cidr=None,port_range_max=,port_range_min=,project_id='068a17bb811448d28e4ba1907f47b8a1',protocol=,remote_address_group_id=,remote_group_id=999e6db3-6caa-46cb-a505-33827a011de7,remote_ip_prefix=,revision_number=0,security_group_id=999e6db3-6caa-46cb-a505-33827a011de7,updated_at=2022-09-30T09:48:45Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:45.451473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (0caf1147-8773-47cc-9a54-d5c341533620), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:45.452019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Security group rule updated ['999e6db3-6caa-46cb-a505-33827a011de7'] Sep 30 09:48:45.452680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:45Z,description=,direction='egress',ethertype='IPv4',id=62903ea6-311c-47d8-b88d-d1d6d2b6c18e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='068a17bb811448d28e4ba1907f47b8a1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=999e6db3-6caa-46cb-a505-33827a011de7,updated_at=2022-09-30T09:48:45Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:45.453301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (62903ea6-311c-47d8-b88d-d1d6d2b6c18e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:45.456970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Security group rule updated ['999e6db3-6caa-46cb-a505-33827a011de7'] Sep 30 09:48:45.457956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:45Z,description=,direction='ingress',ethertype='IPv4',id=fadc32da-79f4-477c-89aa-a4ada2a0fb5d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='068a17bb811448d28e4ba1907f47b8a1',protocol=,remote_address_group_id=,remote_group_id=999e6db3-6caa-46cb-a505-33827a011de7,remote_ip_prefix=,revision_number=0,security_group_id=999e6db3-6caa-46cb-a505-33827a011de7,updated_at=2022-09-30T09:48:45Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:45.458527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (fadc32da-79f4-477c-89aa-a4ada2a0fb5d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:45.458907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Security group rule updated ['999e6db3-6caa-46cb-a505-33827a011de7'] Sep 30 09:48:45.802445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4b0dc396-ca0e-4efa-b071-fb800a6c033b admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(d86893c8-23dc-4287-8168-86de37704efa)],cidr=172.20.0.0/28,created_at=2022-09-30T09:48:45Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=cb979a21-95fe-4786-aec7-486f57a26635,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestShelveInstance-236201644-subnet',network_id=a62b74a3-1997-4c61-bbde-a23d7b16ffe0,project_id='82b48c489465430a836de26d4aa39440',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:48:45Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:45.804320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4b0dc396-ca0e-4efa-b071-fb800a6c033b admin admin] Publish callbacks [] for Subnet (cb979a21-95fe-4786-aec7-486f57a26635), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:46.036889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-97af83ec-c9a4-47b0-872c-0d06dde32dae None None] Resource Port 6becbba2-d82d-4e76-9a4a-a17dc48fbef1 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:46.037808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-97af83ec-c9a4-47b0-872c-0d06dde32dae None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6becbba2-d82d-4e76-9a4a-a17dc48fbef1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:46.211839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:45Z,data_plane_status=None,description='',device_id='c655458b-a040-4717-91aa-3e156bac1764',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=0f24f809-3568-48d6-bb30-cdcc4f2c72c6,mac_address=fa:16:3e:08:09:54,name='',network_id=12053c4e-c351-40a7-b2e4-33aed16dfa36,numa_affinity_policy=,project_id='068a17bb811448d28e4ba1907f47b8a1',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(0f24f809-3568-48d6-bb30-cdcc4f2c72c6),security_group_ids=set([999e6db3-6caa-46cb-a505-33827a011de7]),status='DOWN',updated_at=2022-09-30T09:48:45Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:46.211839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0f24f809-3568-48d6-bb30-cdcc4f2c72c6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:46.212065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3eb1e342-dd58-4ad5-868c-795152b5000f tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Security group member updated {'999e6db3-6caa-46cb-a505-33827a011de7'} Sep 30 09:48:46.336120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:336 started Sep 30 09:48:46.340091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0456,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=839000000,duration_sec=684,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:46.345144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:46.345878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:336 - starting polling. Elapsed:0.010 Sep 30 09:48:46.353893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:46.372090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:336 - port information retrieved. Elapsed:0.028 Sep 30 09:48:46.372090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': set(), 'removed': set(), 'updated': {'6becbba2-d82d-4e76-9a4a-a17dc48fbef1'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:46.372422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'device_id': '37948e78-e1ec-4aee-815b-077ddf094735', 'network_id': '66e518e7-6dfd-46cc-b9d0-1baf366ca8b7', 'port_id': '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'mac_address': 'fa:16:3e:75:89:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f26d679-c954-4e46-831c-7bd0a36da165', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:46.373106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 6becbba2-d82d-4e76-9a4a-a17dc48fbef1 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:46.373725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 6becbba2-d82d-4e76-9a4a-a17dc48fbef1 updated. Details: {'device': '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'device_id': '37948e78-e1ec-4aee-815b-077ddf094735', 'network_id': '66e518e7-6dfd-46cc-b9d0-1baf366ca8b7', 'port_id': '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'mac_address': 'fa:16:3e:75:89:a1', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '6f26d679-c954-4e46-831c-7bd0a36da165', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 9} Sep 30 09:48:46.375304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6becbba2-d8, col_values=(('tag', 9),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:46.376098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-6becbba2-d8, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:46.376823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-6becbba2-d8, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:46.383086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6becbba2-d8, col_values=(('other_config', {'net_uuid': '66e518e7-6dfd-46cc-b9d0-1baf366ca8b7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '9', 'segmentation_id': '381'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:46.426701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0458,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:46.427772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:336 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 19 devices currently available. Time elapsed: 0.063 Sep 30 09:48:46.428407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:48:46.429796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:48:46.431174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:46.433523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:46.445289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:46.543829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf7207-8aa2-4af2-9baa-577ad7f68eab]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:46.544546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:336 - agent port security group processed in 0.179 Sep 30 09:48:46.545570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 6becbba2-d82d-4e76-9a4a-a17dc48fbef1 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:47.037573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['6becbba2-d82d-4e76-9a4a-a17dc48fbef1'] and devices down [] completed. Sep 30 09:48:47.038209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:336 - ports processed. Elapsed:0.702 Sep 30 09:48:47.038505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:336 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.703 Sep 30 09:48:47.076262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d0365548-0243-4a1c-ab3f-90ed96237f19 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:46Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a62b74a3-1997-4c61-bbde-a23d7b16ffe0',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=369d3278-0f1d-4fb4-82c6-97d7f3b3655d,mac_address=fa:16:3e:ef:5c:1c,name='',network_id=a62b74a3-1997-4c61-bbde-a23d7b16ffe0,numa_affinity_policy=,project_id='82b48c489465430a836de26d4aa39440',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(369d3278-0f1d-4fb4-82c6-97d7f3b3655d),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:48:46Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:47.076659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d0365548-0243-4a1c-ab3f-90ed96237f19 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (369d3278-0f1d-4fb4-82c6-97d7f3b3655d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:47.659008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d0365548-0243-4a1c-ab3f-90ed96237f19 None None] Resource Port 369d3278-0f1d-4fb4-82c6-97d7f3b3655d updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=369d3278-0f1d-4fb4-82c6-97d7f3b3655d,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=369d3278-0f1d-4fb4-82c6-97d7f3b3655d,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=369d3278-0f1d-4fb4-82c6-97d7f3b3655d,segment=NetworkSegment(20943992-40cd-4c03-a0f9-331f0f5fa72a),segment_id=20943992-40cd-4c03-a0f9-331f0f5fa72a)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:47.660946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d0365548-0243-4a1c-ab3f-90ed96237f19 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (369d3278-0f1d-4fb4-82c6-97d7f3b3655d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:47.816300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3063bcdd-1ea8-44a4-95f2-007bbeb64b72","insert","tap369d3278-0f",["set",[]],["map",[["attached-mac","fa:16:3e:ef:5c:1c"],["iface-id","369d3278-0f1d-4fb4-82c6-97d7f3b3655d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:47.847910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3063bcdd-1ea8-44a4-95f2-007bbeb64b72","old",null,["set",[]],null],["","new","tap369d3278-0f",24,["map",[["attached-mac","fa:16:3e:ef:5c:1c"],["iface-id","369d3278-0f1d-4fb4-82c6-97d7f3b3655d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:48.336866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:337 started Sep 30 09:48:48.344964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c045a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=842000000,duration_sec=686,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:48.344964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:48.344964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:337 - starting polling. Elapsed:0.008 Sep 30 09:48:48.351006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:48.357004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:337 - port information retrieved. Elapsed:0.020 Sep 30 09:48:48.357940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d'}, 'removed': set(), 'updated': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:48.359274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '369d3278-0f1d-4fb4-82c6-97d7f3b3655d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a62b74a3-1997-4c61-bbde-a23d7b16ffe0', 'network_id': 'a62b74a3-1997-4c61-bbde-a23d7b16ffe0', 'port_id': '369d3278-0f1d-4fb4-82c6-97d7f3b3655d', 'mac_address': 'fa:16:3e:ef:5c:1c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cb979a21-95fe-4786-aec7-486f57a26635', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:48.363621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 369d3278-0f1d-4fb4-82c6-97d7f3b3655d {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:48.364214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 369d3278-0f1d-4fb4-82c6-97d7f3b3655d updated. Details: {'device': '369d3278-0f1d-4fb4-82c6-97d7f3b3655d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a62b74a3-1997-4c61-bbde-a23d7b16ffe0', 'network_id': 'a62b74a3-1997-4c61-bbde-a23d7b16ffe0', 'port_id': '369d3278-0f1d-4fb4-82c6-97d7f3b3655d', 'mac_address': 'fa:16:3e:ef:5c:1c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cb979a21-95fe-4786-aec7-486f57a26635', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:48:48.364767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 10 as local vlan for net-id=a62b74a3-1997-4c61-bbde-a23d7b16ffe0, seg-id=353 Sep 30 09:48:48.370631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xc9105ef8,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4449), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:48.374402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xf1c045c,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4106)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4449}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:48.376123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap369d3278-0f, col_values=(('tag', 10),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:48.376747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap369d3278-0f, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:48.377470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap369d3278-0f, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:48.392321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap369d3278-0f, col_values=(('other_config', {'net_uuid': 'a62b74a3-1997-4c61-bbde-a23d7b16ffe0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '353'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:48.407976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c045e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:48.408323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:337 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.050 Sep 30 09:48:48.409049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:48:48.409523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d'} Sep 30 09:48:48.410772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:48.411217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:48.416607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:48.484717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[17294d00-ef78-4108-b63e-82a08c1863f2]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:48.484717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:337 - agent port security group processed in 0.122 Sep 30 09:48:48.484717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 369d3278-0f1d-4fb4-82c6-97d7f3b3655d to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:48.849920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b454aed5-fe7d-4bef-8ad2-aa5708b131ba service neutron] Resource Port 0f24f809-3568-48d6-bb30-cdcc4f2c72c6 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=0f24f809-3568-48d6-bb30-cdcc4f2c72c6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0f24f809-3568-48d6-bb30-cdcc4f2c72c6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:48.851081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b454aed5-fe7d-4bef-8ad2-aa5708b131ba service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0f24f809-3568-48d6-bb30-cdcc4f2c72c6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:49.357414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['369d3278-0f1d-4fb4-82c6-97d7f3b3655d'] and devices down [] completed. Sep 30 09:48:49.363535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:337 - ports processed. Elapsed:1.027 Sep 30 09:48:49.364148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:337 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:1.027 Sep 30 09:48:49.440241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port 369d3278-0f1d-4fb4-82c6-97d7f3b3655d updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:49.441717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (369d3278-0f1d-4fb4-82c6-97d7f3b3655d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:49.479878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b454aed5-fe7d-4bef-8ad2-aa5708b131ba service neutron] Resource Port 0f24f809-3568-48d6-bb30-cdcc4f2c72c6 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0f24f809-3568-48d6-bb30-cdcc4f2c72c6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=0f24f809-3568-48d6-bb30-cdcc4f2c72c6,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=0f24f809-3568-48d6-bb30-cdcc4f2c72c6,segment=NetworkSegment(6fa4ec80-7280-443d-9bff-e3974e62ecfa),segment_id=6fa4ec80-7280-443d-9bff-e3974e62ecfa)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:49.480647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b454aed5-fe7d-4bef-8ad2-aa5708b131ba service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0f24f809-3568-48d6-bb30-cdcc4f2c72c6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:49.521574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 411b31d5-4a9b-44b2-8ce8-22d9cb075ef9 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:49.521959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (411b31d5-4a9b-44b2-8ce8-22d9cb075ef9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:49.821834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-87132609-17f7-4f49-b434-b211b1eb979b admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:48Z,data_plane_status=None,description='',device_id='db6f149a-34bc-4487-b8ce-0862cd629265',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5ce7c4c9-91a6-4157-b354-718efb743f8e,mac_address=fa:16:3e:d6:7f:eb,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5ce7c4c9-91a6-4157-b354-718efb743f8e),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:48:48Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:49.823755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-87132609-17f7-4f49-b434-b211b1eb979b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5ce7c4c9-91a6-4157-b354-718efb743f8e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:50.338382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:338 started Sep 30 09:48:50.340974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0460,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=841000000,duration_sec=688,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:50.341580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:50.341924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:338 - starting polling. Elapsed:0.004 Sep 30 09:48:50.344655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:50.348348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:338 - port information retrieved. Elapsed:0.010 Sep 30 09:48:50.348696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': set(), 'removed': set(), 'updated': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:50.349271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '369d3278-0f1d-4fb4-82c6-97d7f3b3655d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a62b74a3-1997-4c61-bbde-a23d7b16ffe0', 'network_id': 'a62b74a3-1997-4c61-bbde-a23d7b16ffe0', 'port_id': '369d3278-0f1d-4fb4-82c6-97d7f3b3655d', 'mac_address': 'fa:16:3e:ef:5c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cb979a21-95fe-4786-aec7-486f57a26635', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:50.352855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 369d3278-0f1d-4fb4-82c6-97d7f3b3655d {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:50.353188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 369d3278-0f1d-4fb4-82c6-97d7f3b3655d updated. Details: {'device': '369d3278-0f1d-4fb4-82c6-97d7f3b3655d', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a62b74a3-1997-4c61-bbde-a23d7b16ffe0', 'network_id': 'a62b74a3-1997-4c61-bbde-a23d7b16ffe0', 'port_id': '369d3278-0f1d-4fb4-82c6-97d7f3b3655d', 'mac_address': 'fa:16:3e:ef:5c:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cb979a21-95fe-4786-aec7-486f57a26635', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Sep 30 09:48:50.354817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap369d3278-0f, col_values=(('tag', 10),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:50.355254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap369d3278-0f, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:50.355653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap369d3278-0f, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:50.356129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:50.357335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap369d3278-0f, col_values=(('other_config', {'net_uuid': 'a62b74a3-1997-4c61-bbde-a23d7b16ffe0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '353', 'tag': '10'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:50.358028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:50.363957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0462,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:50.368766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:338 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.015 Sep 30 09:48:50.368766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:48:50.368766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:48:50.368766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:50.368766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:50.390486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:50.432562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0b70b6-ff71-4f42-a9c5-ade19916fa8e]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:50.433194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:338 - agent port security group processed in 0.084 Sep 30 09:48:50.434038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 369d3278-0f1d-4fb4-82c6-97d7f3b3655d to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:50.453597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-aabd3f61-a88e-44e8-813f-e53216b776ea tempest-VolumesActionsTest-1876305362 tempest-VolumesActionsTest-1876305362-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:49Z,data_plane_status=None,description='',device_id='d73628ce-2a02-4ff6-97e2-3f2f9cb0087c',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd,mac_address=fa:16:3e:06:e7:66,name='',network_id=19f705b3-87b0-406c-8a82-287369b1f01f,numa_affinity_policy=,project_id='c1eb9ddbc0a84a308ceffeae5198f229',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd),security_group_ids=set([35fe4fab-f7e7-497f-b77d-71379dee8053]),status='DOWN',updated_at=2022-09-30T09:48:49Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:50.454625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-aabd3f61-a88e-44e8-813f-e53216b776ea tempest-VolumesActionsTest-1876305362 tempest-VolumesActionsTest-1876305362-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:50.454986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-aabd3f61-a88e-44e8-813f-e53216b776ea tempest-VolumesActionsTest-1876305362 tempest-VolumesActionsTest-1876305362-project] Security group member updated {'35fe4fab-f7e7-497f-b77d-71379dee8053'} Sep 30 09:48:50.631862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['369d3278-0f1d-4fb4-82c6-97d7f3b3655d'] and devices down [] completed. Sep 30 09:48:50.632244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:338 - ports processed. Elapsed:0.294 Sep 30 09:48:50.632692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:338 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.295 Sep 30 09:48:51.103174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 411b31d5-4a9b-44b2-8ce8-22d9cb075ef9 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:51.103542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (411b31d5-4a9b-44b2-8ce8-22d9cb075ef9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:52.339067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:339 started Sep 30 09:48:52.343557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0464,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=842000000,duration_sec=690,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:52.344420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:52.344925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:339 - starting polling. Elapsed:0.006 Sep 30 09:48:52.348002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:52.354991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:339 - port information retrieved. Elapsed:0.016 Sep 30 09:48:52.355569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:339 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.017 Sep 30 09:48:52.643424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ac49aded-257b-4e26-b976-dd111c706d29 service neutron] Resource Port ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:52.644729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ac49aded-257b-4e26-b976-dd111c706d29 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:52.649065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e2b7caaf-5653-4181-b0b6-f26f1f2d96bb None None] Resource Port 5ce7c4c9-91a6-4157-b354-718efb743f8e updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=5ce7c4c9-91a6-4157-b354-718efb743f8e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=5ce7c4c9-91a6-4157-b354-718efb743f8e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:52.649685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e2b7caaf-5653-4181-b0b6-f26f1f2d96bb None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5ce7c4c9-91a6-4157-b354-718efb743f8e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:52.965054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:52Z,description='Default security group',id=cab3a28a-9064-45d8-840c-f498965a9069,is_default=True,name='default',project_id='13a92def01b54713a3acf8d15726c7d6',revision_number=1,rules=[SecurityGroupRule(14d31c8b-db1f-4cf9-bb1f-e508d60df440),SecurityGroupRule(32711386-f546-4eab-a240-bd13ca707c8a),SecurityGroupRule(9ba54027-dceb-44b3-b28d-1d8db1414776),SecurityGroupRule(ba39e908-2384-4ed5-a100-8da8e141b604)],shared=False,stateful=True,updated_at=2022-09-30T09:48:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:52.965622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (cab3a28a-9064-45d8-840c-f498965a9069), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:52.966355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:52Z,description=,direction='ingress',ethertype='IPv6',id=14d31c8b-db1f-4cf9-bb1f-e508d60df440,normalized_cidr=None,port_range_max=,port_range_min=,project_id='13a92def01b54713a3acf8d15726c7d6',protocol=,remote_address_group_id=,remote_group_id=cab3a28a-9064-45d8-840c-f498965a9069,remote_ip_prefix=,revision_number=0,security_group_id=cab3a28a-9064-45d8-840c-f498965a9069,updated_at=2022-09-30T09:48:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:52.967005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (14d31c8b-db1f-4cf9-bb1f-e508d60df440), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:52.967593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Security group rule updated ['cab3a28a-9064-45d8-840c-f498965a9069'] Sep 30 09:48:52.968558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:52Z,description=,direction='egress',ethertype='IPv4',id=32711386-f546-4eab-a240-bd13ca707c8a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='13a92def01b54713a3acf8d15726c7d6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cab3a28a-9064-45d8-840c-f498965a9069,updated_at=2022-09-30T09:48:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:52.969167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (32711386-f546-4eab-a240-bd13ca707c8a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:52.969736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Security group rule updated ['cab3a28a-9064-45d8-840c-f498965a9069'] Sep 30 09:48:52.970712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:52Z,description=,direction='egress',ethertype='IPv6',id=9ba54027-dceb-44b3-b28d-1d8db1414776,normalized_cidr=None,port_range_max=,port_range_min=,project_id='13a92def01b54713a3acf8d15726c7d6',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cab3a28a-9064-45d8-840c-f498965a9069,updated_at=2022-09-30T09:48:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:52.971294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (9ba54027-dceb-44b3-b28d-1d8db1414776), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:52.971826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Security group rule updated ['cab3a28a-9064-45d8-840c-f498965a9069'] Sep 30 09:48:52.973623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:52Z,description=,direction='ingress',ethertype='IPv4',id=ba39e908-2384-4ed5-a100-8da8e141b604,normalized_cidr=None,port_range_max=,port_range_min=,project_id='13a92def01b54713a3acf8d15726c7d6',protocol=,remote_address_group_id=,remote_group_id=cab3a28a-9064-45d8-840c-f498965a9069,remote_ip_prefix=,revision_number=0,security_group_id=cab3a28a-9064-45d8-840c-f498965a9069,updated_at=2022-09-30T09:48:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:52.975043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (ba39e908-2384-4ed5-a100-8da8e141b604), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:52.975635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-856f660f-d67f-4fbf-bd5a-58db24bce990 admin admin] Security group rule updated ['cab3a28a-9064-45d8-840c-f498965a9069'] Sep 30 09:48:53.044440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-89f96142-54f4-41dd-b23d-5f482c0336dd admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:48:52Z,data_plane_status=None,description='',device_id='db6f149a-34bc-4487-b8ce-0862cd629265',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=228a7290-58e9-40fa-a1a4-8aaa9c72f58e,mac_address=fa:16:3e:5d:6c:ad,name='',network_id=a62b74a3-1997-4c61-bbde-a23d7b16ffe0,numa_affinity_policy=,project_id='82b48c489465430a836de26d4aa39440',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(228a7290-58e9-40fa-a1a4-8aaa9c72f58e),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:48:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:53.045428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-89f96142-54f4-41dd-b23d-5f482c0336dd admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (228a7290-58e9-40fa-a1a4-8aaa9c72f58e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:53.335935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e2b7caaf-5653-4181-b0b6-f26f1f2d96bb None None] Resource Port 5ce7c4c9-91a6-4157-b354-718efb743f8e updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=5ce7c4c9-91a6-4157-b354-718efb743f8e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=5ce7c4c9-91a6-4157-b354-718efb743f8e,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=5ce7c4c9-91a6-4157-b354-718efb743f8e,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:53.337228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e2b7caaf-5653-4181-b0b6-f26f1f2d96bb None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5ce7c4c9-91a6-4157-b354-718efb743f8e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:53.592074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Resource SecurityGroup deleted: cab3a28a-9064-45d8-840c-f498965a9069 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:53.593086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (cab3a28a-9064-45d8-840c-f498965a9069), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:53.594456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('cab3a28a-9064-45d8-840c-f498965a9069',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:48:53.655391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('cab3a28a-9064-45d8-840c-f498965a9069',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:48:53.655913 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Resource SecurityGroupRule deleted: 14d31c8b-db1f-4cf9-bb1f-e508d60df440 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:53.656281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (14d31c8b-db1f-4cf9-bb1f-e508d60df440), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:53.656608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Security group rule updated ['cab3a28a-9064-45d8-840c-f498965a9069'] Sep 30 09:48:53.656994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Resource SecurityGroupRule deleted: 32711386-f546-4eab-a240-bd13ca707c8a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:53.657419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (32711386-f546-4eab-a240-bd13ca707c8a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:53.657638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Security group rule updated ['cab3a28a-9064-45d8-840c-f498965a9069'] Sep 30 09:48:53.658005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Resource SecurityGroupRule deleted: 9ba54027-dceb-44b3-b28d-1d8db1414776 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:53.658345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (9ba54027-dceb-44b3-b28d-1d8db1414776), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:53.666326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Security group rule updated ['cab3a28a-9064-45d8-840c-f498965a9069'] Sep 30 09:48:53.666704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Resource SecurityGroupRule deleted: ba39e908-2384-4ed5-a100-8da8e141b604 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:53.667076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (ba39e908-2384-4ed5-a100-8da8e141b604), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:53.667398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-73077e11-fc56-46f8-91b1-ce21d36ee789 admin admin] Security group rule updated ['cab3a28a-9064-45d8-840c-f498965a9069'] Sep 30 09:48:53.683883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ac49aded-257b-4e26-b976-dd111c706d29 service neutron] Resource Port ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd,segment=NetworkSegment(11f0f416-ce09-4705-9d84-2507bb4fe522),segment_id=11f0f416-ce09-4705-9d84-2507bb4fe522)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:53.684263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ac49aded-257b-4e26-b976-dd111c706d29 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:53.728254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:53.728680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:53.897215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-89f96142-54f4-41dd-b23d-5f482c0336dd admin admin] Received resource Port update without any changes: 228a7290-58e9-40fa-a1a4-8aaa9c72f58e {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 30 09:48:53.963369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["89387653-c212-4ce5-81a0-5e7a15cd35a2","insert","qg-5ce7c4c9-91",["set",[]],["map",[["attached-mac","fa:16:3e:d6:7f:eb"],["iface-id","5ce7c4c9-91a6-4157-b354-718efb743f8e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:53.990904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["89387653-c212-4ce5-81a0-5e7a15cd35a2","old",null,["set",[]],null],["","new","qg-5ce7c4c9-91",25,["map",[["attached-mac","fa:16:3e:d6:7f:eb"],["iface-id","5ce7c4c9-91a6-4157-b354-718efb743f8e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:54.340412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:340 started Sep 30 09:48:54.343739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0466,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=843000000,duration_sec=692,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:54.345022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:54.345649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:340 - starting polling. Elapsed:0.005 Sep 30 09:48:54.349421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:54.356892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:340 - port information retrieved. Elapsed:0.017 Sep 30 09:48:54.359058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': {'5ce7c4c9-91a6-4157-b354-718efb743f8e'}, 'removed': set(), 'updated': {'5ce7c4c9-91a6-4157-b354-718efb743f8e'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:54.361847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'device_id': 'db6f149a-34bc-4487-b8ce-0862cd629265', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'mac_address': 'fa:16:3e:d6:7f:eb', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.174'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:54.368040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 5ce7c4c9-91a6-4157-b354-718efb743f8e {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:54.370173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 5ce7c4c9-91a6-4157-b354-718efb743f8e updated. Details: {'device': '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'device_id': 'db6f149a-34bc-4487-b8ce-0862cd629265', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'mac_address': 'fa:16:3e:d6:7f:eb', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.174'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:48:54.374504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-5ce7c4c9-91, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:54.375620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-5ce7c4c9-91, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:54.377399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-5ce7c4c9-91, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:54.386393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-5ce7c4c9-91, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:54.396979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0468,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:54.397740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:340 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 21 devices currently available. Time elapsed: 0.038 Sep 30 09:48:54.398308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:48:54.398864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'5ce7c4c9-91a6-4157-b354-718efb743f8e'} Sep 30 09:48:54.400813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:54.401331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:54.406755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:54.467051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f466414b-2904-47cc-935f-a0e8edf22127]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:54.467690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:340 - agent port security group processed in 0.107 Sep 30 09:48:54.468540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 5ce7c4c9-91a6-4157-b354-718efb743f8e to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:54.869426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['5ce7c4c9-91a6-4157-b354-718efb743f8e'] and devices down [] completed. Sep 30 09:48:54.870059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:340 - ports processed. Elapsed:0.530 Sep 30 09:48:54.871613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:340 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.530 Sep 30 09:48:55.008922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port 5ce7c4c9-91a6-4157-b354-718efb743f8e updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=5ce7c4c9-91a6-4157-b354-718efb743f8e,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=5ce7c4c9-91a6-4157-b354-718efb743f8e,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:55.009390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5ce7c4c9-91a6-4157-b354-718efb743f8e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:55.627044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port b4db42a3-b3ea-4c10-8fa2-c3c219dd729e updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:55.627695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (b4db42a3-b3ea-4c10-8fa2-c3c219dd729e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:55.763094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:55.763606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:56.049850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5fae034d-2c0d-4359-90e8-84b5145c8a3e tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:55Z,description='tempest-secgroup-smoke-783740169 description',id=2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f,is_default=False,name='tempest-secgroup-smoke-783740169',project_id='1330031e214045bf9d45c73da1445255',revision_number=1,rules=[SecurityGroupRule(37333e6e-2fb9-4291-89cd-bceec12da950),SecurityGroupRule(973134bc-2d04-4b78-b2c0-d6f8c6f66729)],shared=False,stateful=True,updated_at=2022-09-30T09:48:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:56.050426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5fae034d-2c0d-4359-90e8-84b5145c8a3e tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:56.050720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5fae034d-2c0d-4359-90e8-84b5145c8a3e tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:55Z,description=,direction='egress',ethertype='IPv6',id=37333e6e-2fb9-4291-89cd-bceec12da950,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1330031e214045bf9d45c73da1445255',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f,updated_at=2022-09-30T09:48:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:56.052064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5fae034d-2c0d-4359-90e8-84b5145c8a3e tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (37333e6e-2fb9-4291-89cd-bceec12da950), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:56.052683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5fae034d-2c0d-4359-90e8-84b5145c8a3e tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:48:56.053555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5fae034d-2c0d-4359-90e8-84b5145c8a3e tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:55Z,description=,direction='egress',ethertype='IPv4',id=973134bc-2d04-4b78-b2c0-d6f8c6f66729,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1330031e214045bf9d45c73da1445255',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f,updated_at=2022-09-30T09:48:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:56.054107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5fae034d-2c0d-4359-90e8-84b5145c8a3e tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (973134bc-2d04-4b78-b2c0-d6f8c6f66729), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:56.054651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5fae034d-2c0d-4359-90e8-84b5145c8a3e tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:48:56.164998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 0f24f809-3568-48d6-bb30-cdcc4f2c72c6 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:56.165446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0f24f809-3568-48d6-bb30-cdcc4f2c72c6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:56.343290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:341 started Sep 30 09:48:56.347236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c046a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=846000000,duration_sec=694,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:56.347859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:56.348220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:341 - starting polling. Elapsed:0.005 Sep 30 09:48:56.351017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:56.354968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:341 - port information retrieved. Elapsed:0.012 Sep 30 09:48:56.355496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': set(), 'removed': set(), 'updated': {'5ce7c4c9-91a6-4157-b354-718efb743f8e'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:56.356087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'device_id': 'db6f149a-34bc-4487-b8ce-0862cd629265', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'mac_address': 'fa:16:3e:d6:7f:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.174'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:56.359843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 5ce7c4c9-91a6-4157-b354-718efb743f8e {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:56.360167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 5ce7c4c9-91a6-4157-b354-718efb743f8e updated. Details: {'device': '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'device_id': 'db6f149a-34bc-4487-b8ce-0862cd629265', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'mac_address': 'fa:16:3e:d6:7f:eb', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.174'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:48:56.361242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-5ce7c4c9-91, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:56.361666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-5ce7c4c9-91, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:56.362062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-5ce7c4c9-91, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:56.362763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:56.363537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-5ce7c4c9-91, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:56.364169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:48:56.367578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c046c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:56.367923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:341 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 21 devices currently available. Time elapsed: 0.012 Sep 30 09:48:56.368519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:48:56.368805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:48:56.369965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:56.370243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:56.375054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:56.426022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd36fd33-9001-4f85-a7f8-597017d8fcb1]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:56.431109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:341 - agent port security group processed in 0.071 Sep 30 09:48:56.431109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 5ce7c4c9-91a6-4157-b354-718efb743f8e to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:56.907351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['5ce7c4c9-91a6-4157-b354-718efb743f8e'] and devices down [] completed. Sep 30 09:48:56.907924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:341 - ports processed. Elapsed:0.565 Sep 30 09:48:56.908406 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:341 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.565 Sep 30 09:48:57.117743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-774f6577-0150-43a8-a5ff-d889860ba71f None None] Resource Port 228a7290-58e9-40fa-a1a4-8aaa9c72f58e updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=228a7290-58e9-40fa-a1a4-8aaa9c72f58e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=228a7290-58e9-40fa-a1a4-8aaa9c72f58e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:57.119812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-774f6577-0150-43a8-a5ff-d889860ba71f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (228a7290-58e9-40fa-a1a4-8aaa9c72f58e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.161549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:48:56Z,description='Default security group',id=a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123,is_default=True,name='default',project_id='e1f45a76770149cd8d80b5e7cdd29b38',revision_number=1,rules=[SecurityGroupRule(d1754855-1927-4a5d-917a-d87833f04003),SecurityGroupRule(e75905a5-f137-43f7-a3c3-0fd20aed6894),SecurityGroupRule(f45088c0-de87-49d7-af2a-b1d0f90eca66),SecurityGroupRule(fa36ea4c-58d6-43ff-a741-1ec671898048)],shared=False,stateful=True,updated_at=2022-09-30T09:48:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:57.162066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.162858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:56Z,description=,direction='egress',ethertype='IPv4',id=d1754855-1927-4a5d-917a-d87833f04003,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e1f45a76770149cd8d80b5e7cdd29b38',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123,updated_at=2022-09-30T09:48:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:57.163320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d1754855-1927-4a5d-917a-d87833f04003), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.163747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Security group rule updated ['a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123'] Sep 30 09:48:57.164901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:56Z,description=,direction='ingress',ethertype='IPv4',id=e75905a5-f137-43f7-a3c3-0fd20aed6894,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e1f45a76770149cd8d80b5e7cdd29b38',protocol=,remote_address_group_id=,remote_group_id=a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123,remote_ip_prefix=,revision_number=0,security_group_id=a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123,updated_at=2022-09-30T09:48:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:57.171369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e75905a5-f137-43f7-a3c3-0fd20aed6894), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.179216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Security group rule updated ['a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123'] Sep 30 09:48:57.179216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:56Z,description=,direction='egress',ethertype='IPv6',id=f45088c0-de87-49d7-af2a-b1d0f90eca66,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e1f45a76770149cd8d80b5e7cdd29b38',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123,updated_at=2022-09-30T09:48:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:57.179216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f45088c0-de87-49d7-af2a-b1d0f90eca66), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.179216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Security group rule updated ['a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123'] Sep 30 09:48:57.179685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:56Z,description=,direction='ingress',ethertype='IPv6',id=fa36ea4c-58d6-43ff-a741-1ec671898048,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e1f45a76770149cd8d80b5e7cdd29b38',protocol=,remote_address_group_id=,remote_group_id=a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123,remote_ip_prefix=,revision_number=0,security_group_id=a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123,updated_at=2022-09-30T09:48:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:57.179685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (fa36ea4c-58d6-43ff-a741-1ec671898048), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.179685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-233126b9-11e8-4df0-8284-27f3675aa182 admin admin] Security group rule updated ['a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123'] Sep 30 09:48:57.382039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f7527867-9376-4bd8-b53c-b2f172c99d30 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:56Z,description='',direction='ingress',ethertype='IPv4',id=d855724b-57aa-4d94-86ad-4b66bfe5f227,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='1330031e214045bf9d45c73da1445255',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f,updated_at=2022-09-30T09:48:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:57.383213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f7527867-9376-4bd8-b53c-b2f172c99d30 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d855724b-57aa-4d94-86ad-4b66bfe5f227), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.383639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f7527867-9376-4bd8-b53c-b2f172c99d30 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:48:57.496123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Resource SecurityGroup deleted: a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:57.496806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.497567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:48:57.515550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-774f6577-0150-43a8-a5ff-d889860ba71f None None] Resource Port 228a7290-58e9-40fa-a1a4-8aaa9c72f58e updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=228a7290-58e9-40fa-a1a4-8aaa9c72f58e,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=228a7290-58e9-40fa-a1a4-8aaa9c72f58e,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=228a7290-58e9-40fa-a1a4-8aaa9c72f58e,segment=NetworkSegment(20943992-40cd-4c03-a0f9-331f0f5fa72a),segment_id=20943992-40cd-4c03-a0f9-331f0f5fa72a)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:57.517190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-774f6577-0150-43a8-a5ff-d889860ba71f None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (228a7290-58e9-40fa-a1a4-8aaa9c72f58e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.548176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:48:57.548782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Resource SecurityGroupRule deleted: d1754855-1927-4a5d-917a-d87833f04003 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:57.549223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d1754855-1927-4a5d-917a-d87833f04003), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.549626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Security group rule updated ['a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123'] Sep 30 09:48:57.550087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Resource SecurityGroupRule deleted: e75905a5-f137-43f7-a3c3-0fd20aed6894 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:57.550502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e75905a5-f137-43f7-a3c3-0fd20aed6894), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.550933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Security group rule updated ['a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123'] Sep 30 09:48:57.551603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Resource SecurityGroupRule deleted: f45088c0-de87-49d7-af2a-b1d0f90eca66 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:57.552822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f45088c0-de87-49d7-af2a-b1d0f90eca66), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.553225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Security group rule updated ['a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123'] Sep 30 09:48:57.553998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Resource SecurityGroupRule deleted: fa36ea4c-58d6-43ff-a741-1ec671898048 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:48:57.554541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (fa36ea4c-58d6-43ff-a741-1ec671898048), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.555217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3ff935b5-5cff-4a3f-a04e-cc3699a194e6 admin admin] Security group rule updated ['a2f8f3e6-ffe4-46e8-b6b8-fd3989a20123'] Sep 30 09:48:57.761444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:57.762152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.882539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a63a7199-1109-4f17-bbd5-23b4a3521abd tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:57Z,description='',direction='egress',ethertype='IPv4',id=8875b040-3b63-4112-bf2b-e479c030eaf3,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='1330031e214045bf9d45c73da1445255',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f,updated_at=2022-09-30T09:48:57Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:57.883637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a63a7199-1109-4f17-bbd5-23b4a3521abd tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8875b040-3b63-4112-bf2b-e479c030eaf3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:57.884231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a63a7199-1109-4f17-bbd5-23b4a3521abd tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:48:58.029649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3c812403-b8e5-4e4f-9881-614e15ee7487","insert","qr-228a7290-58",["set",[]],["map",[["attached-mac","fa:16:3e:5d:6c:ad"],["iface-id","228a7290-58e9-40fa-a1a4-8aaa9c72f58e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:58.303522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3c812403-b8e5-4e4f-9881-614e15ee7487","old",null,["set",[]],null],["","new","qr-228a7290-58",26,["map",[["attached-mac","fa:16:3e:5d:6c:ad"],["iface-id","228a7290-58e9-40fa-a1a4-8aaa9c72f58e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:48:58.314691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-74f63e7a-8487-457d-87a0-dc7bc22b62d2 None None] Resource Port 228a7290-58e9-40fa-a1a4-8aaa9c72f58e updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:48:58.314691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-74f63e7a-8487-457d-87a0-dc7bc22b62d2 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (228a7290-58e9-40fa-a1a4-8aaa9c72f58e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:58.344404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:342 started Sep 30 09:48:58.347503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c046e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=847000000,duration_sec=696,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:58.348543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:48:58.348985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:342 - starting polling. Elapsed:0.005 Sep 30 09:48:58.352214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:58.357778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:342 - port information retrieved. Elapsed:0.013 Sep 30 09:48:58.363607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': {'228a7290-58e9-40fa-a1a4-8aaa9c72f58e'}, 'removed': set(), 'updated': {'228a7290-58e9-40fa-a1a4-8aaa9c72f58e'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:48:58.371305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', 'device_id': 'db6f149a-34bc-4487-b8ce-0862cd629265', 'network_id': 'a62b74a3-1997-4c61-bbde-a23d7b16ffe0', 'port_id': '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', 'mac_address': 'fa:16:3e:5d:6c:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cb979a21-95fe-4786-aec7-486f57a26635', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:48:58.375707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 228a7290-58e9-40fa-a1a4-8aaa9c72f58e {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:48:58.397673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 228a7290-58e9-40fa-a1a4-8aaa9c72f58e updated. Details: {'device': '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', 'device_id': 'db6f149a-34bc-4487-b8ce-0862cd629265', 'network_id': 'a62b74a3-1997-4c61-bbde-a23d7b16ffe0', 'port_id': '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', 'mac_address': 'fa:16:3e:5d:6c:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cb979a21-95fe-4786-aec7-486f57a26635', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 10} Sep 30 09:48:58.397673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-228a7290-58, col_values=(('tag', 10),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:58.397673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-228a7290-58, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:58.397673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-228a7290-58, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:58.399490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3cbe5d99-064b-4f47-b500-24db9ad32551 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:58Z,description='',direction='ingress',ethertype='IPv4',id=466ab988-f8fa-4878-b411-66fe3343962e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1330031e214045bf9d45c73da1445255',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f,updated_at=2022-09-30T09:48:58Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:58.399875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3cbe5d99-064b-4f47-b500-24db9ad32551 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (466ab988-f8fa-4878-b411-66fe3343962e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:58.400919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3cbe5d99-064b-4f47-b500-24db9ad32551 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:48:58.404851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-228a7290-58, col_values=(('other_config', {'net_uuid': 'a62b74a3-1997-4c61-bbde-a23d7b16ffe0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '10', 'segmentation_id': '353'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:48:58.414241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0470,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:48:58.414803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:342 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.051 Sep 30 09:48:58.415158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:48:58.415453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'228a7290-58e9-40fa-a1a4-8aaa9c72f58e'} Sep 30 09:48:58.417214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:48:58.417500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:48:58.423073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:48:58.503277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd2ac96-39b4-4999-8ba8-b6e48380e6dd]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:48:58.503929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:342 - agent port security group processed in 0.140 Sep 30 09:48:58.504784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 228a7290-58e9-40fa-a1a4-8aaa9c72f58e to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:48:58.828251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['228a7290-58e9-40fa-a1a4-8aaa9c72f58e'] and devices down [] completed. Sep 30 09:48:58.829626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:342 - ports processed. Elapsed:0.484 Sep 30 09:48:58.830092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:342 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.486 Sep 30 09:48:58.836039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b36704d2-a307-4f72-9d9a-7da41e782748 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:58Z,description='',direction='egress',ethertype='IPv4',id=7be4f570-f126-457a-80d8-5d3d09d484bc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1330031e214045bf9d45c73da1445255',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f,updated_at=2022-09-30T09:48:58Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:58.836422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b36704d2-a307-4f72-9d9a-7da41e782748 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7be4f570-f126-457a-80d8-5d3d09d484bc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:58.837565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b36704d2-a307-4f72-9d9a-7da41e782748 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:48:59.246582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-31ccc545-c04d-4e10-a663-a7574acfd9ba tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:59Z,description='',direction='ingress',ethertype='IPv6',id=29d89b33-2458-4cc8-859e-a8cd82d02cde,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1330031e214045bf9d45c73da1445255',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f,updated_at=2022-09-30T09:48:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:59.248235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-31ccc545-c04d-4e10-a663-a7574acfd9ba tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (29d89b33-2458-4cc8-859e-a8cd82d02cde), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:59.248655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-31ccc545-c04d-4e10-a663-a7574acfd9ba tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:48:59.672231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4cd4692f-6c7a-437e-930b-b0b68f52f1b5 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:48:59Z,description='',direction='egress',ethertype='IPv6',id=3e0e51b2-8684-422a-8032-3300f4b2cf68,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1330031e214045bf9d45c73da1445255',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f,updated_at=2022-09-30T09:48:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:48:59.672231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4cd4692f-6c7a-437e-930b-b0b68f52f1b5 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (3e0e51b2-8684-422a-8032-3300f4b2cf68), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:48:59.672231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4cd4692f-6c7a-437e-930b-b0b68f52f1b5 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:49:00.176240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port b4db42a3-b3ea-4c10-8fa2-c3c219dd729e updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:49:00.176575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (b4db42a3-b3ea-4c10-8fa2-c3c219dd729e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:00.345225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:343 started Sep 30 09:49:00.352513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0472,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=848000000,duration_sec=698,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:00.354372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:00.354757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:343 - starting polling. Elapsed:0.010 Sep 30 09:49:00.360674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:00.373750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:343 - port information retrieved. Elapsed:0.029 Sep 30 09:49:00.374422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:343 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.029 Sep 30 09:49:00.559847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 0f24f809-3568-48d6-bb30-cdcc4f2c72c6 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:49:00.560330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (0f24f809-3568-48d6-bb30-cdcc4f2c72c6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:01.897384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:49:01.898543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:02.345816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:344 started Sep 30 09:49:02.348540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0474,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=848000000,duration_sec=700,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:02.349235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:02.349512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:344 - starting polling. Elapsed:0.004 Sep 30 09:49:02.352375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:02.356455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:344 - port information retrieved. Elapsed:0.011 Sep 30 09:49:02.356794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:344 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:49:04.347122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:345 started Sep 30 09:49:04.349496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0476,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=849000000,duration_sec=702,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:04.350064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:04.350416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:345 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:49:06.347704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:346 started Sep 30 09:49:06.350284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0478,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=850000000,duration_sec=704,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:06.350853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:06.355475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:346 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:49:08.348761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:347 started Sep 30 09:49:08.351280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c047a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=851000000,duration_sec=706,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:08.351786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:08.352132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:347 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:49:10.349965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:348 started Sep 30 09:49:10.352390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c047c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=852000000,duration_sec=708,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:10.352983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:10.353948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:348 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:49:11.572722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c4281221-383c-4c40-85de-ed5f274e7a16 tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Resource Port deleted: 0f24f809-3568-48d6-bb30-cdcc4f2c72c6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:11.573422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c4281221-383c-4c40-85de-ed5f274e7a16 tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (0f24f809-3568-48d6-bb30-cdcc4f2c72c6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:11.573536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c4281221-383c-4c40-85de-ed5f274e7a16 tempest-VolumesNegativeTest-1429228178 tempest-VolumesNegativeTest-1429228178-project] Security group member updated {'999e6db3-6caa-46cb-a505-33827a011de7'} Sep 30 09:49:11.664446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-792ba6ab-bcaa-4b02-9954-1e1e2ec80627 tempest-VolumesActionsTest-1876305362 tempest-VolumesActionsTest-1876305362-project] Resource Port deleted: ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:11.666750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-792ba6ab-bcaa-4b02-9954-1e1e2ec80627 tempest-VolumesActionsTest-1876305362 tempest-VolumesActionsTest-1876305362-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:11.667190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-792ba6ab-bcaa-4b02-9954-1e1e2ec80627 tempest-VolumesActionsTest-1876305362 tempest-VolumesActionsTest-1876305362-project] Security group member updated {'35fe4fab-f7e7-497f-b77d-71379dee8053'} Sep 30 09:49:12.351968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:349 started Sep 30 09:49:12.354381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c047e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=854000000,duration_sec=710,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:12.354981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:12.355314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:349 - starting polling. Elapsed:0.004 Sep 30 09:49:12.358172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:12.360138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd not present in bridge br-int Sep 30 09:49:12.360465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:49:12.362305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 0f24f809-3568-48d6-bb30-cdcc4f2c72c6 not present in bridge br-int Sep 30 09:49:12.362791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:49:12.363002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd', '0f24f809-3568-48d6-bb30-cdcc4f2c72c6'] Sep 30 09:49:12.363253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port ce8d050b-ac4d-44ae-a002-9cb0ed2f51fd is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:49:12.363545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 0f24f809-3568-48d6-bb30-cdcc4f2c72c6 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:49:12.367609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:349 - port information retrieved. Elapsed:0.016 Sep 30 09:49:12.367937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:349 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 30 09:49:14.353019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:350 started Sep 30 09:49:14.355892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0480,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=856000000,duration_sec=712,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:14.356455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:14.356799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:350 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:49:16.354461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:351 started Sep 30 09:49:16.356854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0482,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=857000000,duration_sec=714,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:16.357415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:16.357813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:351 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:49:18.355839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:352 started Sep 30 09:49:18.358254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0484,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=858000000,duration_sec=716,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:18.358866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:18.359223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:352 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:49:20.357157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:353 started Sep 30 09:49:20.359640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0486,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=859000000,duration_sec=718,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:20.360230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:20.360578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:353 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:49:21.860697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3f138cdc-baab-4c58-a8cb-93b5cd2917be tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:49:21Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=7388e982-3506-4600-9030-7f8ec8e36bf6,mac_address=fa:16:3e:ad:de:6a,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(7388e982-3506-4600-9030-7f8ec8e36bf6),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T09:49:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:49:21.869286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3f138cdc-baab-4c58-a8cb-93b5cd2917be tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (7388e982-3506-4600-9030-7f8ec8e36bf6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:22.358671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:354 started Sep 30 09:49:22.366281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0488,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=861000000,duration_sec=720,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:22.366522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:22.367268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:354 - starting polling. Elapsed:0.008 Sep 30 09:49:22.369997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:22.376667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:354 - port information retrieved. Elapsed:0.018 Sep 30 09:49:22.377286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:354 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 30 09:49:22.931972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Resource SecurityGroup deleted: 999e6db3-6caa-46cb-a505-33827a011de7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:22.933012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (999e6db3-6caa-46cb-a505-33827a011de7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:22.933687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('999e6db3-6caa-46cb-a505-33827a011de7',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:49:22.953775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('999e6db3-6caa-46cb-a505-33827a011de7',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:49:22.955080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Resource SecurityGroupRule deleted: 0a56eaca-f8c4-45f9-b6e2-4de3284a0ede {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:22.955537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (0a56eaca-f8c4-45f9-b6e2-4de3284a0ede), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:22.956125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Security group rule updated ['999e6db3-6caa-46cb-a505-33827a011de7'] Sep 30 09:49:22.957689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Resource SecurityGroupRule deleted: 0caf1147-8773-47cc-9a54-d5c341533620 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:22.958257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (0caf1147-8773-47cc-9a54-d5c341533620), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:22.959054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Security group rule updated ['999e6db3-6caa-46cb-a505-33827a011de7'] Sep 30 09:49:22.959929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Resource SecurityGroupRule deleted: 62903ea6-311c-47d8-b88d-d1d6d2b6c18e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:22.961244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (62903ea6-311c-47d8-b88d-d1d6d2b6c18e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:22.961817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Security group rule updated ['999e6db3-6caa-46cb-a505-33827a011de7'] Sep 30 09:49:22.962381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Resource SecurityGroupRule deleted: fadc32da-79f4-477c-89aa-a4ada2a0fb5d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:22.963491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (fadc32da-79f4-477c-89aa-a4ada2a0fb5d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:22.964852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-210e769d-2a2c-4918-98cb-8f1d56cee915 admin admin] Security group rule updated ['999e6db3-6caa-46cb-a505-33827a011de7'] Sep 30 09:49:23.348256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3f138cdc-baab-4c58-a8cb-93b5cd2917be tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource Port 7388e982-3506-4600-9030-7f8ec8e36bf6 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '124cdefd-96b2-49e5-b30e-75d387b8673c'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:49:23.348898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3f138cdc-baab-4c58-a8cb-93b5cd2917be tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (7388e982-3506-4600-9030-7f8ec8e36bf6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:24.359854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:355 started Sep 30 09:49:24.362784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c048a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=862000000,duration_sec=722,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:24.363484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:24.363905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:355 - starting polling. Elapsed:0.004 Sep 30 09:49:24.367587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:24.374142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:355 - port information retrieved. Elapsed:0.013 Sep 30 09:49:24.375691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:355 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 30 09:49:24.634971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-69b42d18-5186-4afd-b791-218697998570 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:49:24Z,description='tempest-secgroup-smoke-1664535141 description',id=a2f2441d-2469-4195-ba5b-d5e2f6ba3152,is_default=False,name='tempest-secgroup-smoke-1664535141',project_id='0be64f8f1d4b452e84a7bcd64f6100d1',revision_number=1,rules=[SecurityGroupRule(45835d88-dc7d-4d90-8b6d-294b89919e35),SecurityGroupRule(c28da464-3167-4eb4-80e0-5cab505277a6)],shared=False,stateful=True,updated_at=2022-09-30T09:49:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:49:24.635828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-69b42d18-5186-4afd-b791-218697998570 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (a2f2441d-2469-4195-ba5b-d5e2f6ba3152), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:24.636688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-69b42d18-5186-4afd-b791-218697998570 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:49:24Z,description=,direction='egress',ethertype='IPv4',id=45835d88-dc7d-4d90-8b6d-294b89919e35,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a2f2441d-2469-4195-ba5b-d5e2f6ba3152,updated_at=2022-09-30T09:49:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:49:24.637257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-69b42d18-5186-4afd-b791-218697998570 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (45835d88-dc7d-4d90-8b6d-294b89919e35), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:24.637832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-69b42d18-5186-4afd-b791-218697998570 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:49:24.638744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-69b42d18-5186-4afd-b791-218697998570 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:49:24Z,description=,direction='egress',ethertype='IPv6',id=c28da464-3167-4eb4-80e0-5cab505277a6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a2f2441d-2469-4195-ba5b-d5e2f6ba3152,updated_at=2022-09-30T09:49:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:49:24.639278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-69b42d18-5186-4afd-b791-218697998570 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c28da464-3167-4eb4-80e0-5cab505277a6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:24.639942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-69b42d18-5186-4afd-b791-218697998570 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:49:25.145102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-152eac76-6cc7-4756-910e-e7cb6e71ce9f tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:49:24Z,description='',direction='ingress',ethertype='IPv4',id=3a5dc02a-ee2e-4b16-a59b-6a9d27ce6a66,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a2f2441d-2469-4195-ba5b-d5e2f6ba3152,updated_at=2022-09-30T09:49:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:49:25.145478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-152eac76-6cc7-4756-910e-e7cb6e71ce9f tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (3a5dc02a-ee2e-4b16-a59b-6a9d27ce6a66), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:25.145846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-152eac76-6cc7-4756-910e-e7cb6e71ce9f tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:49:25.587388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c683e3f7-9cfe-4b18-9913-126914029040 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:49:25Z,description='',direction='egress',ethertype='IPv4',id=bad430fe-4dd8-4f0b-a42e-84d675365a73,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a2f2441d-2469-4195-ba5b-d5e2f6ba3152,updated_at=2022-09-30T09:49:25Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:49:25.588489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c683e3f7-9cfe-4b18-9913-126914029040 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (bad430fe-4dd8-4f0b-a42e-84d675365a73), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:25.588835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c683e3f7-9cfe-4b18-9913-126914029040 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:49:26.064448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-aef576ef-333c-423c-b6e7-2d380e02de63 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:49:25Z,description='',direction='ingress',ethertype='IPv4',id=ddcb598c-2b97-44cb-a76e-ac47a9a85c7a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a2f2441d-2469-4195-ba5b-d5e2f6ba3152,updated_at=2022-09-30T09:49:25Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:49:26.065254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-aef576ef-333c-423c-b6e7-2d380e02de63 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (ddcb598c-2b97-44cb-a76e-ac47a9a85c7a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:26.065897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-aef576ef-333c-423c-b6e7-2d380e02de63 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:49:26.365868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:356 started Sep 30 09:49:26.366408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c048c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=865000000,duration_sec=724,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:26.367408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:26.367856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:356 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:49:26.432880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0363f25b-dc58-45c0-8acc-20ca0c3746d7 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:49:26Z,description='',direction='egress',ethertype='IPv4',id=73780292-f48c-4d3d-976c-f560b8ae856d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a2f2441d-2469-4195-ba5b-d5e2f6ba3152,updated_at=2022-09-30T09:49:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:49:26.433301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0363f25b-dc58-45c0-8acc-20ca0c3746d7 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (73780292-f48c-4d3d-976c-f560b8ae856d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:26.433647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0363f25b-dc58-45c0-8acc-20ca0c3746d7 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:49:26.759919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0d93e337-e27a-42fc-bd39-6cda2a23c1ac tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:49:26Z,description='',direction='ingress',ethertype='IPv6',id=c125f362-878a-4f89-abc4-5f41afd74762,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a2f2441d-2469-4195-ba5b-d5e2f6ba3152,updated_at=2022-09-30T09:49:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:49:26.760959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0d93e337-e27a-42fc-bd39-6cda2a23c1ac tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c125f362-878a-4f89-abc4-5f41afd74762), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:26.761490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0d93e337-e27a-42fc-bd39-6cda2a23c1ac tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:49:27.168989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0d982f08-5347-4e27-b274-b4a92f1ab560 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:49:27Z,description='',direction='egress',ethertype='IPv6',id=ca878974-b805-4068-85a0-25d91cee0a58,normalized_cidr=None,port_range_max=,port_range_min=,project_id='0be64f8f1d4b452e84a7bcd64f6100d1',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a2f2441d-2469-4195-ba5b-d5e2f6ba3152,updated_at=2022-09-30T09:49:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:49:27.169640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0d982f08-5347-4e27-b274-b4a92f1ab560 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (ca878974-b805-4068-85a0-25d91cee0a58), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:27.169981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0d982f08-5347-4e27-b274-b4a92f1ab560 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:49:28.343286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bac399fe-7b36-46ae-8948-95149c782d1d tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource Port 4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3 updated (revision_number 5->6). Old fields: {'security_group_ids': CoercedSet({'486454ec-5304-4b26-ac0e-18fa2421327c'})} New fields: {'security_group_ids': CoercedSet({'486454ec-5304-4b26-ac0e-18fa2421327c', 'a2f2441d-2469-4195-ba5b-d5e2f6ba3152'})} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:49:28.344151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bac399fe-7b36-46ae-8948-95149c782d1d tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:28.344151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bac399fe-7b36-46ae-8948-95149c782d1d tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group member updated {'486454ec-5304-4b26-ac0e-18fa2421327c', 'a2f2441d-2469-4195-ba5b-d5e2f6ba3152'} Sep 30 09:49:28.363632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:357 started Sep 30 09:49:28.368392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c048e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=867000000,duration_sec=726,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:28.369606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:28.370071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:357 - starting polling. Elapsed:0.007 Sep 30 09:49:28.394669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:28.407885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:357 - port information retrieved. Elapsed:0.043 Sep 30 09:49:28.409192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:357 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.046 Sep 30 09:49:28.423688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4690f4ad-0911-4828-a24c-4e431114352d tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:49:27Z,data_plane_status=None,description='',device_id='dcd3d415-addc-4607-844d-2ab1c2c9d16b',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=803fcd8d-66b3-48a0-bc79-84c2e79f336c,mac_address=fa:16:3e:02:66:17,name='',network_id=66e518e7-6dfd-46cc-b9d0-1baf366ca8b7,numa_affinity_policy=,project_id='1330031e214045bf9d45c73da1445255',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(803fcd8d-66b3-48a0-bc79-84c2e79f336c),security_group_ids=set([2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f]),status='DOWN',updated_at=2022-09-30T09:49:27Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:49:28.424316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4690f4ad-0911-4828-a24c-4e431114352d tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (803fcd8d-66b3-48a0-bc79-84c2e79f336c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:28.424983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4690f4ad-0911-4828-a24c-4e431114352d tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group member updated {'2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'} Sep 30 09:49:29.608468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7de8c23a-c776-41cf-8410-67d2ad497b46 service neutron] Resource Port 803fcd8d-66b3-48a0-bc79-84c2e79f336c updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=803fcd8d-66b3-48a0-bc79-84c2e79f336c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=803fcd8d-66b3-48a0-bc79-84c2e79f336c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:49:29.608468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7de8c23a-c776-41cf-8410-67d2ad497b46 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (803fcd8d-66b3-48a0-bc79-84c2e79f336c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:29.943335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7de8c23a-c776-41cf-8410-67d2ad497b46 service neutron] Resource Port 803fcd8d-66b3-48a0-bc79-84c2e79f336c updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=803fcd8d-66b3-48a0-bc79-84c2e79f336c,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=803fcd8d-66b3-48a0-bc79-84c2e79f336c,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=803fcd8d-66b3-48a0-bc79-84c2e79f336c,segment=NetworkSegment(5a960c0a-e5d4-4995-ad68-d03963036798),segment_id=5a960c0a-e5d4-4995-ad68-d03963036798)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:49:29.944066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7de8c23a-c776-41cf-8410-67d2ad497b46 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (803fcd8d-66b3-48a0-bc79-84c2e79f336c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:30.366516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:358 started Sep 30 09:49:30.378955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0490,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=870000000,duration_sec=728,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:30.378955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:30.378955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:358 - starting polling. Elapsed:0.006 Sep 30 09:49:30.378955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:30.385068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:358 - port information retrieved. Elapsed:0.019 Sep 30 09:49:30.385447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:358 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 30 09:49:32.368180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:359 started Sep 30 09:49:32.371262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0492,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=871000000,duration_sec=730,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:32.371827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:32.372411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:359 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:49:34.369903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:360 started Sep 30 09:49:34.375304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0494,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=874000000,duration_sec=732,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:34.376193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:34.376766 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:360 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:49:36.370055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:361 started Sep 30 09:49:36.374222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0496,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=873000000,duration_sec=734,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:36.375162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:36.375670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:361 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:49:38.096523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 803fcd8d-66b3-48a0-bc79-84c2e79f336c updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:49:38.097612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (803fcd8d-66b3-48a0-bc79-84c2e79f336c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:38.371550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:362 started Sep 30 09:49:38.374632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0498,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=874000000,duration_sec=736,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:38.375352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:38.375768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:362 - starting polling. Elapsed:0.004 Sep 30 09:49:38.378722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:38.383314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:362 - port information retrieved. Elapsed:0.012 Sep 30 09:49:38.383888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:362 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 30 09:49:40.187651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 803fcd8d-66b3-48a0-bc79-84c2e79f336c updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:49:40.188558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (803fcd8d-66b3-48a0-bc79-84c2e79f336c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:40.372455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:363 started Sep 30 09:49:40.374876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c049a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=875000000,duration_sec=738,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:40.375446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:40.375782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:363 - starting polling. Elapsed:0.003 Sep 30 09:49:40.378694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:40.382696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:363 - port information retrieved. Elapsed:0.010 Sep 30 09:49:40.383026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:363 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:49:42.373346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:364 started Sep 30 09:49:42.375976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c049c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=876000000,duration_sec=740,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:42.376536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:42.376883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:364 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:49:42.711970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9a062072-fce9-4312-b94e-11a695dc70dc admin admin] Resource Subnet deleted: cc6f8afb-b389-431a-9b53-54a02cc2cc80 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:42.712343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9a062072-fce9-4312-b94e-11a695dc70dc admin admin] Publish callbacks [] for Subnet (cc6f8afb-b389-431a-9b53-54a02cc2cc80), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:43.233921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6bbc2e50-8a48-422d-9b73-d26befb43ad1 admin admin] Resource Network deleted: 19f705b3-87b0-406c-8a82-287369b1f01f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:43.241194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6bbc2e50-8a48-422d-9b73-d26befb43ad1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (19f705b3-87b0-406c-8a82-287369b1f01f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:43.836205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Resource SecurityGroup deleted: 35fe4fab-f7e7-497f-b77d-71379dee8053 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:43.836821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (35fe4fab-f7e7-497f-b77d-71379dee8053), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:43.837257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('35fe4fab-f7e7-497f-b77d-71379dee8053',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:49:43.852185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('35fe4fab-f7e7-497f-b77d-71379dee8053',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:49:43.852806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Resource SecurityGroupRule deleted: 139e43c8-4a86-49da-bd57-7f5b6ed286fc {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:43.853539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (139e43c8-4a86-49da-bd57-7f5b6ed286fc), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:43.853931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Security group rule updated ['35fe4fab-f7e7-497f-b77d-71379dee8053'] Sep 30 09:49:43.854666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Resource SecurityGroupRule deleted: 294e2812-1d8b-4a33-9f4a-bb77f211ba0a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:43.855297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (294e2812-1d8b-4a33-9f4a-bb77f211ba0a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:43.855881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Security group rule updated ['35fe4fab-f7e7-497f-b77d-71379dee8053'] Sep 30 09:49:43.856769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Resource SecurityGroupRule deleted: 547b961c-5084-4509-9aad-77e63de2ce22 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:43.857872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (547b961c-5084-4509-9aad-77e63de2ce22), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:43.858407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Security group rule updated ['35fe4fab-f7e7-497f-b77d-71379dee8053'] Sep 30 09:49:43.859722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Resource SecurityGroupRule deleted: 9d96663b-d5bc-4e2e-a441-0b58b953c7e8 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:49:43.860778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (9d96663b-d5bc-4e2e-a441-0b58b953c7e8), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:43.861821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1dc9cf17-341d-49e4-8ae6-5a9334bd3625 admin admin] Security group rule updated ['35fe4fab-f7e7-497f-b77d-71379dee8053'] Sep 30 09:49:44.374703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:365 started Sep 30 09:49:44.377117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c049e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=877000000,duration_sec=742,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:44.377699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:44.378049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:365 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:49:44.514165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0a1ffce9-31f8-43e7-865d-331b56a26744 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:49:44Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6b819bd9-3ae7-4382-b77d-c975f03af861,mac_address=fa:16:3e:fe:0e:1b,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6b819bd9-3ae7-4382-b77d-c975f03af861),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T09:49:44Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:49:44.514541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0a1ffce9-31f8-43e7-865d-331b56a26744 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6b819bd9-3ae7-4382-b77d-c975f03af861), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:45.264501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0a1ffce9-31f8-43e7-865d-331b56a26744 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Resource Port 6b819bd9-3ae7-4382-b77d-c975f03af861 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '74e0f99c-3fec-4f35-a258-befb33bfec9e'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:49:45.265670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0a1ffce9-31f8-43e7-865d-331b56a26744 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6b819bd9-3ae7-4382-b77d-c975f03af861), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:46.375311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:366 started Sep 30 09:49:46.377838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=878000000,duration_sec=744,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:46.378425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:46.378793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:366 - starting polling. Elapsed:0.004 Sep 30 09:49:46.382078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:49:46.386092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:366 - port information retrieved. Elapsed:0.011 Sep 30 09:49:46.386436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:366 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:49:48.376648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:367 started Sep 30 09:49:48.379314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=879000000,duration_sec=746,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:48.379959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:48.380308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:367 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:49:50.377530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:368 started Sep 30 09:49:50.380067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=880000000,duration_sec=748,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:50.380674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:50.381057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:368 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:49:52.378677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:369 started Sep 30 09:49:52.381199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=881000000,duration_sec=750,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:52.381797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:52.382158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:369 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:49:54.379645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:370 started Sep 30 09:49:54.382141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=882000000,duration_sec=752,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:54.382760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:54.383168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:370 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:49:56.381089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:371 started Sep 30 09:49:56.383546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=883000000,duration_sec=754,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:56.384109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:56.384461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:371 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:49:58.382263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:372 started Sep 30 09:49:58.384709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=885000000,duration_sec=756,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:49:58.385278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:49:58.385634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:372 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:00.383551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:373 started Sep 30 09:50:00.385904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=886000000,duration_sec=758,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:00.386461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:00.386903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:373 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:02.384189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:374 started Sep 30 09:50:02.386638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=886000000,duration_sec=760,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:02.387201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:02.387558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:374 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:04.186871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8e5fd1fe-1caa-453d-89c4-87b6fa387e1d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource Port deleted: b4db42a3-b3ea-4c10-8fa2-c3c219dd729e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:04.187522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8e5fd1fe-1caa-453d-89c4-87b6fa387e1d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (b4db42a3-b3ea-4c10-8fa2-c3c219dd729e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:04.187770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8e5fd1fe-1caa-453d-89c4-87b6fa387e1d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group member updated {'47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf'} Sep 30 09:50:04.385274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:375 started Sep 30 09:50:04.388747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=888000000,duration_sec=762,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:04.388747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:04.389204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:375 - starting polling. Elapsed:0.004 Sep 30 09:50:04.392391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:04.394847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port b4db42a3-b3ea-4c10-8fa2-c3c219dd729e not present in bridge br-int Sep 30 09:50:04.395175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:50:04.395558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['b4db42a3-b3ea-4c10-8fa2-c3c219dd729e'] Sep 30 09:50:04.396058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port b4db42a3-b3ea-4c10-8fa2-c3c219dd729e is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:50:04.410541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:375 - port information retrieved. Elapsed:0.025 Sep 30 09:50:04.414354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:375 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.029 Sep 30 09:50:06.367961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroup deleted: 47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:06.372190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:06.372190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:50:06.383277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:50:06.383658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: 322a2712-e565-4074-a162-d57f991184b3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:06.384191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (322a2712-e565-4074-a162-d57f991184b3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:06.384991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf'] Sep 30 09:50:06.385418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: ea187453-4236-4e2b-a39b-abbbcfae5af4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:06.385910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (ea187453-4236-4e2b-a39b-abbbcfae5af4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:06.386358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf'] Sep 30 09:50:06.386859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: e16146d2-6700-47fd-9021-1c7d97205dea {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:06.387163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e16146d2-6700-47fd-9021-1c7d97205dea), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:06.387476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf'] Sep 30 09:50:06.387836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: f1ef94f8-5e12-4bf8-806b-c9955a7ba8ff {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:06.388176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f1ef94f8-5e12-4bf8-806b-c9955a7ba8ff), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:06.388717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ec14bbb9-72f4-4560-8ff7-b5089bc2ce7d tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['47adac23-f8bf-4aeb-bfcd-1e22ff4c14bf'] Sep 30 09:50:06.389863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:376 started Sep 30 09:50:06.392951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=892000000,duration_sec=764,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:06.393737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:06.394265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:376 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:07.028233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6fc4b3e7-3432-40ce-b34c-4357fd0429a3 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource Port deleted: 1c9a8c50-f2c9-456a-9a09-dcb5f5b7fccc {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:07.028689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6fc4b3e7-3432-40ce-b34c-4357fd0429a3 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (1c9a8c50-f2c9-456a-9a09-dcb5f5b7fccc), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:08.390884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:377 started Sep 30 09:50:08.394170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=893000000,duration_sec=766,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:08.394775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:08.395140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:377 - starting polling. Elapsed:0.004 Sep 30 09:50:08.397964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:08.399937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 1c9a8c50-f2c9-456a-9a09-dcb5f5b7fccc not present in bridge br-int Sep 30 09:50:08.400266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:50:08.400549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['1c9a8c50-f2c9-456a-9a09-dcb5f5b7fccc'] Sep 30 09:50:08.400867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 1c9a8c50-f2c9-456a-9a09-dcb5f5b7fccc is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:50:08.404647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:377 - port information retrieved. Elapsed:0.014 Sep 30 09:50:08.404979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:377 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 30 09:50:10.391760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:378 started Sep 30 09:50:10.394723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04b8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=895000000,duration_sec=768,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:10.395307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:10.395658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:378 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:12.394902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:379 started Sep 30 09:50:12.398976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04ba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=898000000,duration_sec=770,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:12.402612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:12.403111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:379 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:50:14.395205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:380 started Sep 30 09:50:14.401824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=897000000,duration_sec=772,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:14.402425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:14.402847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:380 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:50:16.396274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:381 started Sep 30 09:50:16.398764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04be,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=899000000,duration_sec=774,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:16.399518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:16.399862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:381 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:17.581091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port cc523046-219f-42b7-a7b9-700936140c81 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:50:17.581696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (cc523046-219f-42b7-a7b9-700936140c81), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:18.208397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f415895e-7a34-4598-a059-118fbce8a714 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource Port deleted: cc523046-219f-42b7-a7b9-700936140c81 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:18.215725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f415895e-7a34-4598-a059-118fbce8a714 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (cc523046-219f-42b7-a7b9-700936140c81), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:18.216428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f415895e-7a34-4598-a059-118fbce8a714 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group member updated {'2cd1a216-c2a2-4cfa-a192-c5feb95a64d5'} Sep 30 09:50:18.397552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:382 started Sep 30 09:50:18.400115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04c0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=900000000,duration_sec=776,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:18.400846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:18.401067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:382 - starting polling. Elapsed:0.004 Sep 30 09:50:18.404022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:18.406014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port cc523046-219f-42b7-a7b9-700936140c81 not present in bridge br-int Sep 30 09:50:18.406350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:50:18.406706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['cc523046-219f-42b7-a7b9-700936140c81'] Sep 30 09:50:18.407034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port cc523046-219f-42b7-a7b9-700936140c81 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:50:18.411342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:382 - port information retrieved. Elapsed:0.014 Sep 30 09:50:18.415344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:382 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 30 09:50:20.398189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:383 started Sep 30 09:50:20.400984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04c2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=900000000,duration_sec=778,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:20.401555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:20.401902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:383 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:21.363342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroup deleted: 2cd1a216-c2a2-4cfa-a192-c5feb95a64d5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:21.363794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (2cd1a216-c2a2-4cfa-a192-c5feb95a64d5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:21.364339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2cd1a216-c2a2-4cfa-a192-c5feb95a64d5',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:50:21.378312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2cd1a216-c2a2-4cfa-a192-c5feb95a64d5',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:50:21.378770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: 7511811a-39fd-4139-83d5-66fca5a2c281 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:21.379136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7511811a-39fd-4139-83d5-66fca5a2c281), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:21.379469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['2cd1a216-c2a2-4cfa-a192-c5feb95a64d5'] Sep 30 09:50:21.379857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: 7718bfbf-332a-4871-9aa5-79178515a6ca {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:21.380203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7718bfbf-332a-4871-9aa5-79178515a6ca), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:21.380521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['2cd1a216-c2a2-4cfa-a192-c5feb95a64d5'] Sep 30 09:50:21.380889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: ce0fab4b-7b15-43c5-ad44-178cf19fee07 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:21.381230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (ce0fab4b-7b15-43c5-ad44-178cf19fee07), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:21.381547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['2cd1a216-c2a2-4cfa-a192-c5feb95a64d5'] Sep 30 09:50:21.381911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: 600a8701-c3ce-448f-bedb-6c5c1c59c722 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:21.382251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (600a8701-c3ce-448f-bedb-6c5c1c59c722), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:21.382570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3e7681a9-f9ec-44d1-ab81-4eae3e6c3baa tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['2cd1a216-c2a2-4cfa-a192-c5feb95a64d5'] Sep 30 09:50:21.815424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-013d3edc-f9f6-42ab-b4ac-cf5dacb40cec tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource Port deleted: 5fab9566-6968-43d0-88cc-d3c1a3c6b4ec {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:21.816028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-013d3edc-f9f6-42ab-b4ac-cf5dacb40cec tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (5fab9566-6968-43d0-88cc-d3c1a3c6b4ec), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:22.331015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cf27a804-7ddd-428f-a3ef-6d9585b03fe4 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:50:22Z,description='tempest-description--752280190',id=38da2223-513e-44c4-98ae-77fbb1f57697,is_default=False,name='tempest-securitygroup--351958239',project_id='86e6b0501cb94028be07bddd2182638b',revision_number=1,rules=[SecurityGroupRule(9027b7db-8c05-43c1-ab83-29fcff4f337a),SecurityGroupRule(acdf1ca6-a68a-47c1-b37c-f56242ef0077)],shared=False,stateful=True,updated_at=2022-09-30T09:50:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:22.331396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cf27a804-7ddd-428f-a3ef-6d9585b03fe4 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (38da2223-513e-44c4-98ae-77fbb1f57697), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:22.332082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cf27a804-7ddd-428f-a3ef-6d9585b03fe4 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:50:22Z,description=,direction='egress',ethertype='IPv6',id=9027b7db-8c05-43c1-ab83-29fcff4f337a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38da2223-513e-44c4-98ae-77fbb1f57697,updated_at=2022-09-30T09:50:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:22.332445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cf27a804-7ddd-428f-a3ef-6d9585b03fe4 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (9027b7db-8c05-43c1-ab83-29fcff4f337a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:22.332778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cf27a804-7ddd-428f-a3ef-6d9585b03fe4 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['38da2223-513e-44c4-98ae-77fbb1f57697'] Sep 30 09:50:22.333453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cf27a804-7ddd-428f-a3ef-6d9585b03fe4 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:50:22Z,description=,direction='egress',ethertype='IPv4',id=acdf1ca6-a68a-47c1-b37c-f56242ef0077,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38da2223-513e-44c4-98ae-77fbb1f57697,updated_at=2022-09-30T09:50:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:22.333802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cf27a804-7ddd-428f-a3ef-6d9585b03fe4 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (acdf1ca6-a68a-47c1-b37c-f56242ef0077), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:22.334200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cf27a804-7ddd-428f-a3ef-6d9585b03fe4 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['38da2223-513e-44c4-98ae-77fbb1f57697'] Sep 30 09:50:22.399518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:384 started Sep 30 09:50:22.402935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=902000000,duration_sec=780,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:22.403601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:22.403993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:384 - starting polling. Elapsed:0.005 Sep 30 09:50:22.407484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:22.410167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 5fab9566-6968-43d0-88cc-d3c1a3c6b4ec not present in bridge br-int Sep 30 09:50:22.410498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:50:22.410799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['5fab9566-6968-43d0-88cc-d3c1a3c6b4ec'] Sep 30 09:50:22.411121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 5fab9566-6968-43d0-88cc-d3c1a3c6b4ec is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:50:22.414991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:384 - port information retrieved. Elapsed:0.016 Sep 30 09:50:22.426793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:384 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 30 09:50:22.611125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-865514f2-e433-45f0-8a30-b946375f1e83 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:50:22Z,description='',direction='ingress',ethertype='IPv4',id=81131084-a508-4412-8c80-d330688294be,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='86e6b0501cb94028be07bddd2182638b',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38da2223-513e-44c4-98ae-77fbb1f57697,updated_at=2022-09-30T09:50:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:22.611508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-865514f2-e433-45f0-8a30-b946375f1e83 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (81131084-a508-4412-8c80-d330688294be), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:22.611854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-865514f2-e433-45f0-8a30-b946375f1e83 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['38da2223-513e-44c4-98ae-77fbb1f57697'] Sep 30 09:50:22.888781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d6bf4b28-b313-4b8e-b635-81313e592601 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:50:22Z,description='',direction='ingress',ethertype='IPv4',id=22a6f274-c9a2-45a3-9775-57d53911c53c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=38da2223-513e-44c4-98ae-77fbb1f57697,updated_at=2022-09-30T09:50:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:22.889453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d6bf4b28-b313-4b8e-b635-81313e592601 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (22a6f274-c9a2-45a3-9775-57d53911c53c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:22.889568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d6bf4b28-b313-4b8e-b635-81313e592601 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['38da2223-513e-44c4-98ae-77fbb1f57697'] Sep 30 09:50:23.575971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-45e849d0-1d5a-4903-a473-3080596d9222 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:50:23Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6671e850-25ca-4183-8340-e801d0d5775c,mac_address=fa:16:3e:85:3c:57,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6671e850-25ca-4183-8340-e801d0d5775c),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T09:50:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:23.577857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-45e849d0-1d5a-4903-a473-3080596d9222 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6671e850-25ca-4183-8340-e801d0d5775c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:24.056435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-45e849d0-1d5a-4903-a473-3080596d9222 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource Port 6671e850-25ca-4183-8340-e801d0d5775c updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '6ca2be8f-fc55-47a4-ac29-5781c8317fc2'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:50:24.056997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-45e849d0-1d5a-4903-a473-3080596d9222 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6671e850-25ca-4183-8340-e801d0d5775c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:24.305685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:50:24Z,description='Default security group',id=39fea3e3-dcbf-4f06-a7b0-2383661bc5bc,is_default=True,name='default',project_id='f38d95783f784d68806d1b2f1d5c4b1c',revision_number=1,rules=[SecurityGroupRule(0c18232c-3984-4a29-bd99-88df6d995753),SecurityGroupRule(8130c22c-e391-4972-9aeb-0388d7570a9f),SecurityGroupRule(bc3c8d91-3d10-4640-882e-e668d2b11e6e),SecurityGroupRule(c5eba12b-e647-462f-9c4e-7a959109f3a3)],shared=False,stateful=True,updated_at=2022-09-30T09:50:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:24.306700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (39fea3e3-dcbf-4f06-a7b0-2383661bc5bc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:24.308399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:50:24Z,description=,direction='ingress',ethertype='IPv6',id=0c18232c-3984-4a29-bd99-88df6d995753,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f38d95783f784d68806d1b2f1d5c4b1c',protocol=,remote_address_group_id=,remote_group_id=39fea3e3-dcbf-4f06-a7b0-2383661bc5bc,remote_ip_prefix=,revision_number=0,security_group_id=39fea3e3-dcbf-4f06-a7b0-2383661bc5bc,updated_at=2022-09-30T09:50:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:24.309116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (0c18232c-3984-4a29-bd99-88df6d995753), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:24.309555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Security group rule updated ['39fea3e3-dcbf-4f06-a7b0-2383661bc5bc'] Sep 30 09:50:24.310522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:50:24Z,description=,direction='egress',ethertype='IPv4',id=8130c22c-e391-4972-9aeb-0388d7570a9f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f38d95783f784d68806d1b2f1d5c4b1c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=39fea3e3-dcbf-4f06-a7b0-2383661bc5bc,updated_at=2022-09-30T09:50:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:24.311025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8130c22c-e391-4972-9aeb-0388d7570a9f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:24.311495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Security group rule updated ['39fea3e3-dcbf-4f06-a7b0-2383661bc5bc'] Sep 30 09:50:24.312367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:50:24Z,description=,direction='egress',ethertype='IPv6',id=bc3c8d91-3d10-4640-882e-e668d2b11e6e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f38d95783f784d68806d1b2f1d5c4b1c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=39fea3e3-dcbf-4f06-a7b0-2383661bc5bc,updated_at=2022-09-30T09:50:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:24.312851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (bc3c8d91-3d10-4640-882e-e668d2b11e6e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:24.313532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Security group rule updated ['39fea3e3-dcbf-4f06-a7b0-2383661bc5bc'] Sep 30 09:50:24.317827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:50:24Z,description=,direction='ingress',ethertype='IPv4',id=c5eba12b-e647-462f-9c4e-7a959109f3a3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f38d95783f784d68806d1b2f1d5c4b1c',protocol=,remote_address_group_id=,remote_group_id=39fea3e3-dcbf-4f06-a7b0-2383661bc5bc,remote_ip_prefix=,revision_number=0,security_group_id=39fea3e3-dcbf-4f06-a7b0-2383661bc5bc,updated_at=2022-09-30T09:50:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:24.318140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c5eba12b-e647-462f-9c4e-7a959109f3a3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:24.318478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-080f64a2-2a48-4574-9296-3fc4853073c4 admin admin] Security group rule updated ['39fea3e3-dcbf-4f06-a7b0-2383661bc5bc'] Sep 30 09:50:24.400113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:385 started Sep 30 09:50:24.402789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04c6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=903000000,duration_sec=782,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:24.403400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:24.403740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:385 - starting polling. Elapsed:0.004 Sep 30 09:50:24.407048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:24.411687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:385 - port information retrieved. Elapsed:0.012 Sep 30 09:50:24.412028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:385 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 30 09:50:24.528872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Resource SecurityGroup deleted: 39fea3e3-dcbf-4f06-a7b0-2383661bc5bc {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:24.529465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (39fea3e3-dcbf-4f06-a7b0-2383661bc5bc), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:24.530511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('39fea3e3-dcbf-4f06-a7b0-2383661bc5bc',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:50:24.545698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('39fea3e3-dcbf-4f06-a7b0-2383661bc5bc',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:50:24.547086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Resource SecurityGroupRule deleted: 0c18232c-3984-4a29-bd99-88df6d995753 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:24.547698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (0c18232c-3984-4a29-bd99-88df6d995753), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:24.549098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Security group rule updated ['39fea3e3-dcbf-4f06-a7b0-2383661bc5bc'] Sep 30 09:50:24.549682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Resource SecurityGroupRule deleted: 8130c22c-e391-4972-9aeb-0388d7570a9f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:24.550220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8130c22c-e391-4972-9aeb-0388d7570a9f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:24.550730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Security group rule updated ['39fea3e3-dcbf-4f06-a7b0-2383661bc5bc'] Sep 30 09:50:24.551334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Resource SecurityGroupRule deleted: bc3c8d91-3d10-4640-882e-e668d2b11e6e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:24.551689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (bc3c8d91-3d10-4640-882e-e668d2b11e6e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:24.552514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Security group rule updated ['39fea3e3-dcbf-4f06-a7b0-2383661bc5bc'] Sep 30 09:50:24.552895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Resource SecurityGroupRule deleted: c5eba12b-e647-462f-9c4e-7a959109f3a3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:24.553246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c5eba12b-e647-462f-9c4e-7a959109f3a3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:24.553568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c6efad19-31a1-4766-adb4-8ca81faace48 admin admin] Security group rule updated ['39fea3e3-dcbf-4f06-a7b0-2383661bc5bc'] Sep 30 09:50:26.117613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:50:25Z,description='Default security group',id=5d4b07af-fe86-47c7-ac14-1ea489912242,is_default=True,name='default',project_id='b3db64185ae94cefa4efa6f3e03c2f7e',revision_number=1,rules=[SecurityGroupRule(1a8663ea-5986-433b-a6b3-8083c5266206),SecurityGroupRule(4bca92b1-88f3-402b-b8ad-32f4850aa565),SecurityGroupRule(5639f81a-cfcc-48c2-9762-4aa673521456),SecurityGroupRule(8af735cf-2210-46b5-8c03-8314b260dd29)],shared=False,stateful=True,updated_at=2022-09-30T09:50:25Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:26.118859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (5d4b07af-fe86-47c7-ac14-1ea489912242), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:26.119706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:50:25Z,description=,direction='ingress',ethertype='IPv6',id=1a8663ea-5986-433b-a6b3-8083c5266206,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b3db64185ae94cefa4efa6f3e03c2f7e',protocol=,remote_address_group_id=,remote_group_id=5d4b07af-fe86-47c7-ac14-1ea489912242,remote_ip_prefix=,revision_number=0,security_group_id=5d4b07af-fe86-47c7-ac14-1ea489912242,updated_at=2022-09-30T09:50:25Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:26.120518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (1a8663ea-5986-433b-a6b3-8083c5266206), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:26.121073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Security group rule updated ['5d4b07af-fe86-47c7-ac14-1ea489912242'] Sep 30 09:50:26.121963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:50:25Z,description=,direction='ingress',ethertype='IPv4',id=4bca92b1-88f3-402b-b8ad-32f4850aa565,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b3db64185ae94cefa4efa6f3e03c2f7e',protocol=,remote_address_group_id=,remote_group_id=5d4b07af-fe86-47c7-ac14-1ea489912242,remote_ip_prefix=,revision_number=0,security_group_id=5d4b07af-fe86-47c7-ac14-1ea489912242,updated_at=2022-09-30T09:50:25Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:26.122527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4bca92b1-88f3-402b-b8ad-32f4850aa565), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:26.123151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Security group rule updated ['5d4b07af-fe86-47c7-ac14-1ea489912242'] Sep 30 09:50:26.124183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:50:25Z,description=,direction='egress',ethertype='IPv4',id=5639f81a-cfcc-48c2-9762-4aa673521456,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b3db64185ae94cefa4efa6f3e03c2f7e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5d4b07af-fe86-47c7-ac14-1ea489912242,updated_at=2022-09-30T09:50:25Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:26.127665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5639f81a-cfcc-48c2-9762-4aa673521456), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:26.128256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Security group rule updated ['5d4b07af-fe86-47c7-ac14-1ea489912242'] Sep 30 09:50:26.129267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:50:25Z,description=,direction='egress',ethertype='IPv6',id=8af735cf-2210-46b5-8c03-8314b260dd29,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b3db64185ae94cefa4efa6f3e03c2f7e',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5d4b07af-fe86-47c7-ac14-1ea489912242,updated_at=2022-09-30T09:50:25Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:26.131635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8af735cf-2210-46b5-8c03-8314b260dd29), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:26.132254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Security group rule updated ['5d4b07af-fe86-47c7-ac14-1ea489912242'] Sep 30 09:50:26.360972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:50:26Z,description='',dns_domain=None,id=70073525-5499-4f0a-9017-eb0ecf8cf458,mtu=1500,name='tempest-VolumesSnapshotTestJSON-724635073-network',project_id='b3db64185ae94cefa4efa6f3e03c2f7e',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(70073525-5499-4f0a-9017-eb0ecf8cf458),segments=[NetworkSegment(d4d12f31-d9ff-4a87-9234-3f21f2c5f3a3)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:50:26Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:26.362294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (70073525-5499-4f0a-9017-eb0ecf8cf458), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:26.401094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:386 started Sep 30 09:50:26.403598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=903000000,duration_sec=784,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:26.404219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:26.404574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:386 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:26.438197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-d3d30223-8c4f-42e4-9a2e-77999fe864c8 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 70073525-5499-4f0a-9017-eb0ecf8cf458 with segmentation id not found. Sep 30 09:50:26.438197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:50:26.438197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:50:26.438197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:50:26.438197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:50:26.438197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:50:26.438197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:50:26.438197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:50:26.438197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:50:26.438197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:50:26.438197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:50:26.438197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:50:26.438197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:50:26.440856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:50:26.440856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:50:26.440856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:50:26.440856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 70073525-5499-4f0a-9017-eb0ecf8cf458 with segmentation id not found. Sep 30 09:50:26.440856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:50:26.883618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-97684ccb-178c-4390-8696-cc1303c42d3f admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(2fa748bc-424f-4a93-aa7d-dbc3160c0c38)],cidr=172.20.0.0/28,created_at=2022-09-30T09:50:26Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=2e053116-efc1-4be8-a3be-3b29e4f3d43e,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesSnapshotTestJSON-724635073-subnet',network_id=70073525-5499-4f0a-9017-eb0ecf8cf458,project_id='b3db64185ae94cefa4efa6f3e03c2f7e',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:50:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:26.883935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-97684ccb-178c-4390-8696-cc1303c42d3f admin admin] Publish callbacks [] for Subnet (2e053116-efc1-4be8-a3be-3b29e4f3d43e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:28.401763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:387 started Sep 30 09:50:28.404373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=904000000,duration_sec=786,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:28.405093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:28.405469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:387 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:28.561361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6ac6a272-d91e-431e-a219-d3b866619639 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:50:28Z,data_plane_status=None,description='',device_id='27d777c7-ef67-43f8-a47c-eafb863feb81',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3e38c79a-a565-45f6-a69a-e39595512b01,mac_address=fa:16:3e:ae:81:08,name='',network_id=d038a068-f643-497f-8e6f-7d6e8fb5892b,numa_affinity_policy=,project_id='86e6b0501cb94028be07bddd2182638b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3e38c79a-a565-45f6-a69a-e39595512b01),security_group_ids=set([38da2223-513e-44c4-98ae-77fbb1f57697]),status='DOWN',updated_at=2022-09-30T09:50:28Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:28.562650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6ac6a272-d91e-431e-a219-d3b866619639 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3e38c79a-a565-45f6-a69a-e39595512b01), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:28.563120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6ac6a272-d91e-431e-a219-d3b866619639 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group member updated {'38da2223-513e-44c4-98ae-77fbb1f57697'} Sep 30 09:50:29.207088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9aeb36ab-a8f9-441b-9a19-2d9ede3e1c1d service neutron] Resource Port 3e38c79a-a565-45f6-a69a-e39595512b01 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=3e38c79a-a565-45f6-a69a-e39595512b01,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=3e38c79a-a565-45f6-a69a-e39595512b01,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:50:29.207810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9aeb36ab-a8f9-441b-9a19-2d9ede3e1c1d service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3e38c79a-a565-45f6-a69a-e39595512b01), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:29.526828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9aeb36ab-a8f9-441b-9a19-2d9ede3e1c1d service neutron] Resource Port 3e38c79a-a565-45f6-a69a-e39595512b01 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=3e38c79a-a565-45f6-a69a-e39595512b01,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=3e38c79a-a565-45f6-a69a-e39595512b01,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=3e38c79a-a565-45f6-a69a-e39595512b01,segment=NetworkSegment(e6b17fb5-eb11-41c5-b8ac-1188c97e0520),segment_id=e6b17fb5-eb11-41c5-b8ac-1188c97e0520)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:50:29.527463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9aeb36ab-a8f9-441b-9a19-2d9ede3e1c1d service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3e38c79a-a565-45f6-a69a-e39595512b01), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:30.402795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:388 started Sep 30 09:50:30.405239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=905000000,duration_sec=788,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:30.405839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:30.406173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:388 - starting polling. Elapsed:0.004 Sep 30 09:50:30.409032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:30.412955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:388 - port information retrieved. Elapsed:0.010 Sep 30 09:50:30.413270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:388 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:50:32.403853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:389 started Sep 30 09:50:32.406263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=906000000,duration_sec=790,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:32.406858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:32.407209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:389 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:33.371867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-64e35894-9dd3-44c6-ad44-ab5ab3df5c49 tempest-VolumesSnapshotTestJSON-1827020212 tempest-VolumesSnapshotTestJSON-1827020212-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:50:32Z,data_plane_status=None,description='',device_id='ae248c85-ab02-421e-9593-35d3e6b2d91f',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=a9cb82d6-80f6-4a57-8692-df8965508945,mac_address=fa:16:3e:24:72:9d,name='',network_id=70073525-5499-4f0a-9017-eb0ecf8cf458,numa_affinity_policy=,project_id='b3db64185ae94cefa4efa6f3e03c2f7e',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(a9cb82d6-80f6-4a57-8692-df8965508945),security_group_ids=set([5d4b07af-fe86-47c7-ac14-1ea489912242]),status='DOWN',updated_at=2022-09-30T09:50:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:50:33.372386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-64e35894-9dd3-44c6-ad44-ab5ab3df5c49 tempest-VolumesSnapshotTestJSON-1827020212 tempest-VolumesSnapshotTestJSON-1827020212-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (a9cb82d6-80f6-4a57-8692-df8965508945), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:33.373231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-64e35894-9dd3-44c6-ad44-ab5ab3df5c49 tempest-VolumesSnapshotTestJSON-1827020212 tempest-VolumesSnapshotTestJSON-1827020212-project] Security group member updated {'5d4b07af-fe86-47c7-ac14-1ea489912242'} Sep 30 09:50:33.805645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 3e38c79a-a565-45f6-a69a-e39595512b01 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:50:33.806313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3e38c79a-a565-45f6-a69a-e39595512b01), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:33.999198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec6a12e8-439a-4f13-afcc-6c92847fb0b3 service neutron] Resource Port a9cb82d6-80f6-4a57-8692-df8965508945 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=a9cb82d6-80f6-4a57-8692-df8965508945,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=a9cb82d6-80f6-4a57-8692-df8965508945,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:50:33.999911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec6a12e8-439a-4f13-afcc-6c92847fb0b3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (a9cb82d6-80f6-4a57-8692-df8965508945), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:34.325451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec6a12e8-439a-4f13-afcc-6c92847fb0b3 service neutron] Resource Port a9cb82d6-80f6-4a57-8692-df8965508945 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=a9cb82d6-80f6-4a57-8692-df8965508945,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=a9cb82d6-80f6-4a57-8692-df8965508945,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=a9cb82d6-80f6-4a57-8692-df8965508945,segment=NetworkSegment(d4d12f31-d9ff-4a87-9234-3f21f2c5f3a3),segment_id=d4d12f31-d9ff-4a87-9234-3f21f2c5f3a3)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:50:34.325823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec6a12e8-439a-4f13-afcc-6c92847fb0b3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (a9cb82d6-80f6-4a57-8692-df8965508945), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:34.404624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:390 started Sep 30 09:50:34.407395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=907000000,duration_sec=792,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:34.415948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:34.415948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:390 - starting polling. Elapsed:0.004 Sep 30 09:50:34.415948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:34.415948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:390 - port information retrieved. Elapsed:0.010 Sep 30 09:50:34.415948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:390 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:50:35.742963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 3e38c79a-a565-45f6-a69a-e39595512b01 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:50:35.746192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3e38c79a-a565-45f6-a69a-e39595512b01), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:36.405250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:391 started Sep 30 09:50:36.408720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=908000000,duration_sec=794,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:36.409295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:36.409631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:391 - starting polling. Elapsed:0.005 Sep 30 09:50:36.412526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:36.416520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:391 - port information retrieved. Elapsed:0.011 Sep 30 09:50:36.416790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:391 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 30 09:50:38.406687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:392 started Sep 30 09:50:38.411316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=911000000,duration_sec=796,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:38.411929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:38.412320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:392 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:50:39.698454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port a9cb82d6-80f6-4a57-8692-df8965508945 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:50:39.699130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (a9cb82d6-80f6-4a57-8692-df8965508945), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:40.408215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:393 started Sep 30 09:50:40.410664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=910000000,duration_sec=798,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:40.411665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:40.412010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:393 - starting polling. Elapsed:0.004 Sep 30 09:50:40.414871 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:40.418706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:393 - port information retrieved. Elapsed:0.011 Sep 30 09:50:40.419039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:393 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:50:41.863886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port a9cb82d6-80f6-4a57-8692-df8965508945 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:50:41.864484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (a9cb82d6-80f6-4a57-8692-df8965508945), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:42.409323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:394 started Sep 30 09:50:42.411720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=912000000,duration_sec=800,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:42.412297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:42.412832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:394 - starting polling. Elapsed:0.004 Sep 30 09:50:42.415631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:42.419506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:394 - port information retrieved. Elapsed:0.010 Sep 30 09:50:42.422554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:394 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:50:44.409916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:395 started Sep 30 09:50:44.412381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04da,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=912000000,duration_sec=802,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:44.412946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:44.413294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:395 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:46.411038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:396 started Sep 30 09:50:46.413378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=913000000,duration_sec=804,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:46.413946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:46.414297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:396 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:48.412936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:397 started Sep 30 09:50:48.415328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04de,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=915000000,duration_sec=806,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:48.415903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:48.416258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:397 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:50.413097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:398 started Sep 30 09:50:50.415662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04e0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=915000000,duration_sec=808,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:50.416230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:50.416575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:398 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:52.414007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:399 started Sep 30 09:50:52.416469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=916000000,duration_sec=810,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:52.417147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:52.417528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:399 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:54.414965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:400 started Sep 30 09:50:54.417781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=917000000,duration_sec=812,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:54.418438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:54.418901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:400 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:50:56.043665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-74fb854f-f357-4025-a5dd-df9fde5f2816 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource Port 4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3 updated (revision_number 6->7). Old fields: {'security_group_ids': CoercedSet({'486454ec-5304-4b26-ac0e-18fa2421327c', 'a2f2441d-2469-4195-ba5b-d5e2f6ba3152'})} New fields: {'security_group_ids': CoercedSet({'486454ec-5304-4b26-ac0e-18fa2421327c'})} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:50:56.044224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-74fb854f-f357-4025-a5dd-df9fde5f2816 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:56.044479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-74fb854f-f357-4025-a5dd-df9fde5f2816 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group member updated {'486454ec-5304-4b26-ac0e-18fa2421327c', 'a2f2441d-2469-4195-ba5b-d5e2f6ba3152'} Sep 30 09:50:56.330098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource SecurityGroup deleted: a2f2441d-2469-4195-ba5b-d5e2f6ba3152 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:56.330473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (a2f2441d-2469-4195-ba5b-d5e2f6ba3152), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:56.331452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a2f2441d-2469-4195-ba5b-d5e2f6ba3152',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:50:56.351045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a2f2441d-2469-4195-ba5b-d5e2f6ba3152',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:50:56.352173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource SecurityGroupRule deleted: 45835d88-dc7d-4d90-8b6d-294b89919e35 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:56.352549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (45835d88-dc7d-4d90-8b6d-294b89919e35), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:56.352883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:50:56.353359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource SecurityGroupRule deleted: c28da464-3167-4eb4-80e0-5cab505277a6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:56.354559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c28da464-3167-4eb4-80e0-5cab505277a6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:56.355652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:50:56.356034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource SecurityGroupRule deleted: 3a5dc02a-ee2e-4b16-a59b-6a9d27ce6a66 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:56.356392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (3a5dc02a-ee2e-4b16-a59b-6a9d27ce6a66), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:56.356686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:50:56.357057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource SecurityGroupRule deleted: bad430fe-4dd8-4f0b-a42e-84d675365a73 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:56.358862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (bad430fe-4dd8-4f0b-a42e-84d675365a73), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:56.359444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:50:56.359833 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource SecurityGroupRule deleted: ddcb598c-2b97-44cb-a76e-ac47a9a85c7a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:56.360353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (ddcb598c-2b97-44cb-a76e-ac47a9a85c7a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:56.360688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:50:56.361055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource SecurityGroupRule deleted: 73780292-f48c-4d3d-976c-f560b8ae856d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:56.361394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (73780292-f48c-4d3d-976c-f560b8ae856d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:56.361706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:50:56.362066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource SecurityGroupRule deleted: c125f362-878a-4f89-abc4-5f41afd74762 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:56.362401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c125f362-878a-4f89-abc4-5f41afd74762), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:56.362738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:50:56.363095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource SecurityGroupRule deleted: ca878974-b805-4068-85a0-25d91cee0a58 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:56.363428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (ca878974-b805-4068-85a0-25d91cee0a58), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:56.363728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e10770cb-bc80-48a0-8842-892c80045a8b tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group rule updated ['a2f2441d-2469-4195-ba5b-d5e2f6ba3152'] Sep 30 09:50:56.416337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:401 started Sep 30 09:50:56.419361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04e6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=919000000,duration_sec=814,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:56.420147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:56.420646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:401 - starting polling. Elapsed:0.005 Sep 30 09:50:56.423531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:56.427504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:401 - port information retrieved. Elapsed:0.011 Sep 30 09:50:56.428823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:401 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 30 09:50:57.056905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0c238474-92cf-4efb-a569-5e4680f2ff61 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource Port deleted: 7388e982-3506-4600-9030-7f8ec8e36bf6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:50:57.057540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0c238474-92cf-4efb-a569-5e4680f2ff61 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (7388e982-3506-4600-9030-7f8ec8e36bf6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:58.417947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:402 started Sep 30 09:50:58.420536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04e8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=920000000,duration_sec=816,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:50:58.421289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:50:58.421698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:402 - starting polling. Elapsed:0.004 Sep 30 09:50:58.425654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:50:58.428342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 7388e982-3506-4600-9030-7f8ec8e36bf6 not present in bridge br-int Sep 30 09:50:58.428701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:50:58.428989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['7388e982-3506-4600-9030-7f8ec8e36bf6'] Sep 30 09:50:58.429321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 7388e982-3506-4600-9030-7f8ec8e36bf6 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:50:58.433324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:402 - port information retrieved. Elapsed:0.015 Sep 30 09:50:58.433806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:402 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.016 Sep 30 09:51:00.418921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:403 started Sep 30 09:51:00.421420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=921000000,duration_sec=818,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:00.422153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:00.422496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:403 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:51:02.420387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:404 started Sep 30 09:51:02.422768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=923000000,duration_sec=820,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:02.423332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:02.423706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:404 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:51:04.421368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:405 started Sep 30 09:51:04.423977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04ee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=924000000,duration_sec=822,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:04.424570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:04.424920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:405 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:51:04.577585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c891d168-4ac6-4ec4-ba86-9894d358c3a5 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Resource Port deleted: 4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:04.577993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c891d168-4ac6-4ec4-ba86-9894d358c3a5 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:04.578412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c891d168-4ac6-4ec4-ba86-9894d358c3a5 tempest-TestMinimumBasicScenario-604383834 tempest-TestMinimumBasicScenario-604383834-project] Security group member updated {'486454ec-5304-4b26-ac0e-18fa2421327c'} Sep 30 09:51:06.422452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:406 started Sep 30 09:51:06.424860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=925000000,duration_sec=824,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:06.425414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:06.425745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:406 - starting polling. Elapsed:0.003 Sep 30 09:51:06.428654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:06.431158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3 not present in bridge br-int Sep 30 09:51:06.431499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:51:06.431857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3'] Sep 30 09:51:06.432117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 4c2d7372-a2b5-4fdb-9ea8-cb7f35b53fc3 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:51:06.435911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:406 - port information retrieved. Elapsed:0.014 Sep 30 09:51:06.436235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:406 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 30 09:51:08.423095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:407 started Sep 30 09:51:08.425503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04f2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=925000000,duration_sec=826,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:08.426027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:08.426374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:407 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:51:08.898746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f5eb2ea3-1213-41d5-8006-ec47a7a84f93 admin admin] Resource Port deleted: 0e2e4418-df17-4fc2-8cfc-e77a0c696b6c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:08.899126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f5eb2ea3-1213-41d5-8006-ec47a7a84f93 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (0e2e4418-df17-4fc2-8cfc-e77a0c696b6c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:09.856203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["249d03ba-159b-4ebb-8641-857c47e9e1d5","delete","qr-0e2e4418-df",17,["map",[["attached-mac","fa:16:3e:40:d6:92"],["iface-id","0e2e4418-df17-4fc2-8cfc-e77a0c696b6c"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:09.987463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c45c22d0-77a0-4364-a204-1d971dc2eb0c admin admin] Resource Port deleted: d72d1c4d-bf3d-4bc6-884d-d0a700f1a025 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:09.987864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c45c22d0-77a0-4364-a204-1d971dc2eb0c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (d72d1c4d-bf3d-4bc6-884d-d0a700f1a025), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:10.238280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["4cc8a185-a35f-4186-9da1-0f02166d91c4","delete","qg-d72d1c4d-bf",16,["map",[["attached-mac","fa:16:3e:af:bf:d5"],["iface-id","d72d1c4d-bf3d-4bc6-884d-d0a700f1a025"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:10.424346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:408 started Sep 30 09:51:10.537187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04f4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=30000000,duration_sec=829,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:10.546241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:10.546848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:408 - starting polling. Elapsed:0.123 Sep 30 09:51:10.549601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:10.557203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c04f6,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 16}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:10.559695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c04f8,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 17}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:10.560160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:408 - port information retrieved. Elapsed:0.136 Sep 30 09:51:10.560669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'f2c8073f-d898-4b31-8e4f-86102bf18fab', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': set(), 'removed': {'0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:10.561007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:408 - agent port security group processed in 0.000 Sep 30 09:51:10.563452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:51:10.563764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025'} Sep 30 09:51:10.564255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 8 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:10.603861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[58efa795-40f8-404a-b6b6-84d661506818]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:10.604446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'0e2e4418-df17-4fc2-8cfc-e77a0c696b6c', 'd72d1c4d-bf3d-4bc6-884d-d0a700f1a025'} removed Sep 30 09:51:10.657902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:51:10.658988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:408 - treat_devices_removed completed in 0.095 Sep 30 09:51:10.659377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:408 - ports processed. Elapsed:0.235 Sep 30 09:51:10.659902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:408 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.236 Sep 30 09:51:10.876356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-411dcebc-290e-4e24-8013-00ffac5d24fb admin admin] Resource Subnet deleted: 509cb759-bc8e-41b1-b266-190b5b61d2ee {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:10.876944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-411dcebc-290e-4e24-8013-00ffac5d24fb admin admin] Publish callbacks [] for Subnet (509cb759-bc8e-41b1-b266-190b5b61d2ee), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:11.013411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f9763554-8d7c-461c-8267-dd1582ee2da9","delete","tapf2c8073f-d8",15,["map",[["attached-mac","fa:16:3e:c3:58:a8"],["iface-id","f2c8073f-d898-4b31-8e4f-86102bf18fab"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:11.262489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a1aa55d8-6e0d-45e3-939b-c556240b92cf admin admin] Resource Port deleted: f2c8073f-d898-4b31-8e4f-86102bf18fab {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:11.262489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a1aa55d8-6e0d-45e3-939b-c556240b92cf admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (f2c8073f-d898-4b31-8e4f-86102bf18fab), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:11.285991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a9d2869f-6300-4dcd-b041-aaef843618b3 None None] Resource Port deleted: f2c8073f-d898-4b31-8e4f-86102bf18fab {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:11.286448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a9d2869f-6300-4dcd-b041-aaef843618b3 None None] Skipped duplicate delete event for f2c8073f-d898-4b31-8e4f-86102bf18fab {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 30 09:51:11.560758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a1aa55d8-6e0d-45e3-939b-c556240b92cf admin admin] Resource Network deleted: 5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:11.563318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a1aa55d8-6e0d-45e3-939b-c556240b92cf admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:12.425301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:409 started Sep 30 09:51:12.428324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c04fa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=928000000,duration_sec=830,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:12.428904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:12.429912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:409 - starting polling. Elapsed:0.004 Sep 30 09:51:12.432506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:12.437424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c04fc,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 15}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:12.437755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:409 - port information retrieved. Elapsed:0.013 Sep 30 09:51:12.438064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', '2795f7af-2ae3-4060-b5b3-8867e124821e', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a'}, 'added': set(), 'removed': {'f2c8073f-d898-4b31-8e4f-86102bf18fab'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:12.438395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:409 - agent port security group processed in 0.000 Sep 30 09:51:12.440666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:51:12.440971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'f2c8073f-d898-4b31-8e4f-86102bf18fab'} Sep 30 09:51:12.441411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:12.445821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-169e8da4-fd50-42b1-96e3-bfb3b7a6d4f6 admin admin] Resource Port deleted: 2795f7af-2ae3-4060-b5b3-8867e124821e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:12.446609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-169e8da4-fd50-42b1-96e3-bfb3b7a6d4f6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (2795f7af-2ae3-4060-b5b3-8867e124821e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:12.491716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[129ed0ab-0ca2-49e4-882e-125dc6f6ca61]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:12.492304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'f2c8073f-d898-4b31-8e4f-86102bf18fab'} removed Sep 30 09:51:12.524243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:51:12.524736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Reclaiming vlan = 7 from net-id = 5fc7a94e-ea2f-40e2-8326-488bd0c4fbe7, seg-id = 358 Sep 30 09:51:12.527380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xc9105efa,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16864421859504038737,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4103}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:12.530866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xf1c04fe,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4454}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:12.531443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:409 - treat_devices_removed completed in 0.090 Sep 30 09:51:12.532992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:409 - ports processed. Elapsed:0.107 Sep 30 09:51:12.532992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:409 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.107 Sep 30 09:51:13.491412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["aa63e5af-e3fe-469e-87fb-1a88fd53a71c","delete","qr-2795f7af-2a",19,["map",[["attached-mac","fa:16:3e:1f:12:97"],["iface-id","2795f7af-2ae3-4060-b5b3-8867e124821e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:13.700307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6153d476-ccd4-4190-b32a-bf4feff2e21b admin admin] Resource Port deleted: a7e8ba1a-cd90-4c12-a089-d7e77fa9531a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:13.700307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6153d476-ccd4-4190-b32a-bf4feff2e21b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (a7e8ba1a-cd90-4c12-a089-d7e77fa9531a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:13.893116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["22250689-566d-442b-b653-3fae5dceed2f","delete","qg-a7e8ba1a-cd",20,["map",[["attached-mac","fa:16:3e:c2:4d:ac"],["iface-id","a7e8ba1a-cd90-4c12-a089-d7e77fa9531a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:14.283432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ec2c983d-cbd6-4f5e-91f5-20d1dffd051d admin admin] Resource Subnet deleted: 1bc9d9ab-4fb8-4e97-9d6f-78f2c2201033 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:14.283999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ec2c983d-cbd6-4f5e-91f5-20d1dffd051d admin admin] Publish callbacks [] for Subnet (1bc9d9ab-4fb8-4e97-9d6f-78f2c2201033), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:14.405343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5d249a69-bc33-4d2c-abbb-d71cffab6cbb","delete","tap56cef7a4-f7",18,["map",[["attached-mac","fa:16:3e:0e:0c:b5"],["iface-id","56cef7a4-f777-4bf3-94ed-8e22c13f3e1a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:14.427518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:410 started Sep 30 09:51:14.432457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0500,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=931000000,duration_sec=832,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:14.433224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:14.433756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:410 - starting polling. Elapsed:0.007 Sep 30 09:51:14.436385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:14.442953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0502,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 18}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:14.446073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0504,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 19}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:14.448633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0506,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 20}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:14.449128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:410 - port information retrieved. Elapsed:0.023 Sep 30 09:51:14.449736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', '2795f7af-2ae3-4060-b5b3-8867e124821e'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:14.450845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:410 - agent port security group processed in 0.000 Sep 30 09:51:14.456802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:51:14.457283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', '2795f7af-2ae3-4060-b5b3-8867e124821e'} Sep 30 09:51:14.458002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 12 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:14.514209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ef07b5-2978-4c74-991c-a84434b8e931]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:14.519850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'56cef7a4-f777-4bf3-94ed-8e22c13f3e1a', 'a7e8ba1a-cd90-4c12-a089-d7e77fa9531a', '2795f7af-2ae3-4060-b5b3-8867e124821e'} removed Sep 30 09:51:14.713837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ab5c7676-28be-4ca6-9198-f9541b63cb18 admin admin] Resource Port deleted: 56cef7a4-f777-4bf3-94ed-8e22c13f3e1a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:14.717070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ab5c7676-28be-4ca6-9198-f9541b63cb18 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (56cef7a4-f777-4bf3-94ed-8e22c13f3e1a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:14.925185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c0177965-2b80-4627-8858-9d702f4b0344 None None] Resource Port deleted: 56cef7a4-f777-4bf3-94ed-8e22c13f3e1a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:14.925450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c0177965-2b80-4627-8858-9d702f4b0344 None None] Skipped duplicate delete event for 56cef7a4-f777-4bf3-94ed-8e22c13f3e1a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 30 09:51:14.927556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:51:14.928069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Reclaiming vlan = 8 from net-id = decc2ed9-0cd5-446c-93ae-1347454cf54d, seg-id = 369 Sep 30 09:51:14.934098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xc9105efc,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16864421859504038737,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4104}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:14.936726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xf1c0508,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4465}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:14.937032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:410 - treat_devices_removed completed in 0.480 Sep 30 09:51:14.937320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:410 - ports processed. Elapsed:0.511 Sep 30 09:51:14.937646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:410 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.511 Sep 30 09:51:15.237624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ab5c7676-28be-4ca6-9198-f9541b63cb18 admin admin] Resource Network deleted: decc2ed9-0cd5-446c-93ae-1347454cf54d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:15.238034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ab5c7676-28be-4ca6-9198-f9541b63cb18 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (decc2ed9-0cd5-446c-93ae-1347454cf54d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:15.661340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Resource SecurityGroup deleted: 486454ec-5304-4b26-ac0e-18fa2421327c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:15.661928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (486454ec-5304-4b26-ac0e-18fa2421327c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:15.662173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('486454ec-5304-4b26-ac0e-18fa2421327c',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:51:15.676083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('486454ec-5304-4b26-ac0e-18fa2421327c',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:51:15.676595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Resource SecurityGroupRule deleted: 692c465d-3cc5-4dc6-a377-0b986627c4f1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:15.676965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (692c465d-3cc5-4dc6-a377-0b986627c4f1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:15.677302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Security group rule updated ['486454ec-5304-4b26-ac0e-18fa2421327c'] Sep 30 09:51:15.677703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Resource SecurityGroupRule deleted: 7d02ee22-1856-41dc-8dbb-f894138080bc {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:15.678053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7d02ee22-1856-41dc-8dbb-f894138080bc), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:15.678378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Security group rule updated ['486454ec-5304-4b26-ac0e-18fa2421327c'] Sep 30 09:51:15.678839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Resource SecurityGroupRule deleted: abe2ad70-5ffd-402d-afa3-40c1855b04b8 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:15.679201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (abe2ad70-5ffd-402d-afa3-40c1855b04b8), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:15.679524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Security group rule updated ['486454ec-5304-4b26-ac0e-18fa2421327c'] Sep 30 09:51:15.679898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Resource SecurityGroupRule deleted: b85de6ff-91af-4638-8711-8d760f93f72b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:15.680243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b85de6ff-91af-4638-8711-8d760f93f72b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:15.680561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8c8f1cb8-7ebd-41f3-80ed-f44c06d8cc5d admin admin] Security group rule updated ['486454ec-5304-4b26-ac0e-18fa2421327c'] Sep 30 09:51:16.427260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:411 started Sep 30 09:51:16.430291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c050a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=930000000,duration_sec=834,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:16.430941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:16.431281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:411 - starting polling. Elapsed:0.004 Sep 30 09:51:16.433633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:16.435276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 56cef7a4-f777-4bf3-94ed-8e22c13f3e1a not present in bridge br-int Sep 30 09:51:16.437640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:51:16.437640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['56cef7a4-f777-4bf3-94ed-8e22c13f3e1a'] Sep 30 09:51:16.437640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 56cef7a4-f777-4bf3-94ed-8e22c13f3e1a is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:51:16.439121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:411 - port information retrieved. Elapsed:0.012 Sep 30 09:51:16.439451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:411 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 30 09:51:16.527586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Resource SecurityGroup deleted: 9cc7f8a8-de97-4711-a8c3-fa8a6927227c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:16.528019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (9cc7f8a8-de97-4711-a8c3-fa8a6927227c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:16.528447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('9cc7f8a8-de97-4711-a8c3-fa8a6927227c',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:51:16.542948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('9cc7f8a8-de97-4711-a8c3-fa8a6927227c',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:51:16.543446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Resource SecurityGroupRule deleted: 2ed4c684-3c7b-463a-b1cb-2e1f0183d0fd {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:16.543989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2ed4c684-3c7b-463a-b1cb-2e1f0183d0fd), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:16.544343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Security group rule updated ['9cc7f8a8-de97-4711-a8c3-fa8a6927227c'] Sep 30 09:51:16.544853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Resource SecurityGroupRule deleted: 379497d9-cf69-4a48-b9f6-7a67bddbe7b8 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:16.545227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (379497d9-cf69-4a48-b9f6-7a67bddbe7b8), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:16.545548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Security group rule updated ['9cc7f8a8-de97-4711-a8c3-fa8a6927227c'] Sep 30 09:51:16.545919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Resource SecurityGroupRule deleted: 4fd468ef-55f4-4c7f-a137-be898c10a846 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:16.546261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4fd468ef-55f4-4c7f-a137-be898c10a846), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:16.546578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Security group rule updated ['9cc7f8a8-de97-4711-a8c3-fa8a6927227c'] Sep 30 09:51:16.546990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Resource SecurityGroupRule deleted: e8615b25-13ad-47c4-a597-4d2ef46ca1e6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:16.547331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e8615b25-13ad-47c4-a597-4d2ef46ca1e6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:16.547649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a4e281ed-5aff-43d0-bb40-20020d876db0 admin admin] Security group rule updated ['9cc7f8a8-de97-4711-a8c3-fa8a6927227c'] Sep 30 09:51:17.976297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:51:17Z,description='Default security group',id=8d4b6639-6e2e-4411-9eed-9ee6bccd6d66,is_default=True,name='default',project_id='f0d0c96bbb304882b1f2459361551a93',revision_number=1,rules=[SecurityGroupRule(225aaa06-9cb6-447d-a723-e9a6905aedc9),SecurityGroupRule(2afbb227-44c0-48eb-b149-e45b418b1cb1),SecurityGroupRule(683ebe9e-a23c-48eb-a450-e77458fb77c3),SecurityGroupRule(695fe5dc-2144-457a-8150-a052e7557d6a)],shared=False,stateful=True,updated_at=2022-09-30T09:51:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:17.976976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (8d4b6639-6e2e-4411-9eed-9ee6bccd6d66), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:17.977497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:17Z,description=,direction='ingress',ethertype='IPv6',id=225aaa06-9cb6-447d-a723-e9a6905aedc9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f0d0c96bbb304882b1f2459361551a93',protocol=,remote_address_group_id=,remote_group_id=8d4b6639-6e2e-4411-9eed-9ee6bccd6d66,remote_ip_prefix=,revision_number=0,security_group_id=8d4b6639-6e2e-4411-9eed-9ee6bccd6d66,updated_at=2022-09-30T09:51:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:17.978450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (225aaa06-9cb6-447d-a723-e9a6905aedc9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:17.979203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Security group rule updated ['8d4b6639-6e2e-4411-9eed-9ee6bccd6d66'] Sep 30 09:51:17.979921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:17Z,description=,direction='egress',ethertype='IPv4',id=2afbb227-44c0-48eb-b149-e45b418b1cb1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f0d0c96bbb304882b1f2459361551a93',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8d4b6639-6e2e-4411-9eed-9ee6bccd6d66,updated_at=2022-09-30T09:51:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:17.987139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2afbb227-44c0-48eb-b149-e45b418b1cb1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:17.987484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Security group rule updated ['8d4b6639-6e2e-4411-9eed-9ee6bccd6d66'] Sep 30 09:51:17.988232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:17Z,description=,direction='egress',ethertype='IPv6',id=683ebe9e-a23c-48eb-a450-e77458fb77c3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f0d0c96bbb304882b1f2459361551a93',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8d4b6639-6e2e-4411-9eed-9ee6bccd6d66,updated_at=2022-09-30T09:51:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:17.988602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (683ebe9e-a23c-48eb-a450-e77458fb77c3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:17.988920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Security group rule updated ['8d4b6639-6e2e-4411-9eed-9ee6bccd6d66'] Sep 30 09:51:17.989587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:17Z,description=,direction='ingress',ethertype='IPv4',id=695fe5dc-2144-457a-8150-a052e7557d6a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f0d0c96bbb304882b1f2459361551a93',protocol=,remote_address_group_id=,remote_group_id=8d4b6639-6e2e-4411-9eed-9ee6bccd6d66,remote_ip_prefix=,revision_number=0,security_group_id=8d4b6639-6e2e-4411-9eed-9ee6bccd6d66,updated_at=2022-09-30T09:51:17Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:17.989978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (695fe5dc-2144-457a-8150-a052e7557d6a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:17.990304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Security group rule updated ['8d4b6639-6e2e-4411-9eed-9ee6bccd6d66'] Sep 30 09:51:18.235853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:51:17Z,description='',dns_domain=None,id=3408b8b1-1a84-4fa0-8af6-da7419c2525d,mtu=1500,name='tempest-TestVolumeBootPattern-1911956325-network',project_id='f0d0c96bbb304882b1f2459361551a93',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(3408b8b1-1a84-4fa0-8af6-da7419c2525d),segments=[NetworkSegment(765b8827-dc41-4d9e-be01-6115a3b03c81)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:51:17Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:18.240936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (3408b8b1-1a84-4fa0-8af6-da7419c2525d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:18.309404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-4fed2886-d9aa-4ed8-8213-c8a138988981 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3408b8b1-1a84-4fa0-8af6-da7419c2525d with segmentation id not found. Sep 30 09:51:18.309404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:51:18.309404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:51:18.309404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:51:18.309404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:51:18.309404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:51:18.309404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:51:18.309404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:51:18.309404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:51:18.309404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:51:18.309404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:51:18.309404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:51:18.309404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:51:18.310702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:51:18.310702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:51:18.310702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:51:18.310702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 3408b8b1-1a84-4fa0-8af6-da7419c2525d with segmentation id not found. Sep 30 09:51:18.310702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:51:18.428423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:412 started Sep 30 09:51:18.432119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c050c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=932000000,duration_sec=836,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:18.432764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:18.433116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:412 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:51:18.843593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3794d74a-9041-443f-b956-7f4c6125af8a admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(f70766c0-e2f9-44a8-90c1-ca40c0f0017c)],cidr=172.20.0.0/28,created_at=2022-09-30T09:51:18Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=17feeb99-a150-43e4-9bdf-e5689885a334,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-1911956325-subnet',network_id=3408b8b1-1a84-4fa0-8af6-da7419c2525d,project_id='f0d0c96bbb304882b1f2459361551a93',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:51:18Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:18.844058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3794d74a-9041-443f-b956-7f4c6125af8a admin admin] Publish callbacks [] for Subnet (17feeb99-a150-43e4-9bdf-e5689885a334), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:19.595873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e9e1e13e-57c5-478d-91e8-6f2c966949a7 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:51:19Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3408b8b1-1a84-4fa0-8af6-da7419c2525d',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fd42b73f-bf14-484c-8d39-4446ddb373b6,mac_address=fa:16:3e:63:9f:1d,name='',network_id=3408b8b1-1a84-4fa0-8af6-da7419c2525d,numa_affinity_policy=,project_id='f0d0c96bbb304882b1f2459361551a93',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fd42b73f-bf14-484c-8d39-4446ddb373b6),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:51:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:19.597882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e9e1e13e-57c5-478d-91e8-6f2c966949a7 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (fd42b73f-bf14-484c-8d39-4446ddb373b6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:19.883006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e9e1e13e-57c5-478d-91e8-6f2c966949a7 None None] Resource Port fd42b73f-bf14-484c-8d39-4446ddb373b6 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fd42b73f-bf14-484c-8d39-4446ddb373b6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fd42b73f-bf14-484c-8d39-4446ddb373b6,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=fd42b73f-bf14-484c-8d39-4446ddb373b6,segment=NetworkSegment(765b8827-dc41-4d9e-be01-6115a3b03c81),segment_id=765b8827-dc41-4d9e-be01-6115a3b03c81)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:19.883549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e9e1e13e-57c5-478d-91e8-6f2c966949a7 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (fd42b73f-bf14-484c-8d39-4446ddb373b6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:19.974497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["01d9f98d-1b09-491e-afa7-a4e464117ef3","insert","tapfd42b73f-bf",["set",[]],["map",[["attached-mac","fa:16:3e:63:9f:1d"],["iface-id","fd42b73f-bf14-484c-8d39-4446ddb373b6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:20.012523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["01d9f98d-1b09-491e-afa7-a4e464117ef3","old",null,["set",[]],null],["","new","tapfd42b73f-bf",27,["map",[["attached-mac","fa:16:3e:63:9f:1d"],["iface-id","fd42b73f-bf14-484c-8d39-4446ddb373b6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:20.258848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1bb910c5-332d-42c3-81ba-091798036949 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:51:19Z,data_plane_status=None,description='',device_id='a4e40616-4f27-407b-b1db-b2c3393c44d2',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6c896384-3d9b-4662-a8e4-e5f3e48a43bc,mac_address=fa:16:3e:1a:74:6e,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6c896384-3d9b-4662-a8e4-e5f3e48a43bc),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:51:19Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:20.259332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1bb910c5-332d-42c3-81ba-091798036949 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6c896384-3d9b-4662-a8e4-e5f3e48a43bc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:20.429679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:413 started Sep 30 09:51:20.432228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c050e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=932000000,duration_sec=838,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:20.432829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:20.433283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:413 - starting polling. Elapsed:0.004 Sep 30 09:51:20.435785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:20.438957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:413 - port information retrieved. Elapsed:0.010 Sep 30 09:51:20.439365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': {'fd42b73f-bf14-484c-8d39-4446ddb373b6'}, 'removed': set(), 'updated': {'fd42b73f-bf14-484c-8d39-4446ddb373b6'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:20.439865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3408b8b1-1a84-4fa0-8af6-da7419c2525d', 'network_id': '3408b8b1-1a84-4fa0-8af6-da7419c2525d', 'port_id': 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'mac_address': 'fa:16:3e:63:9f:1d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 367, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '17feeb99-a150-43e4-9bdf-e5689885a334', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:51:20.443175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: fd42b73f-bf14-484c-8d39-4446ddb373b6 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:51:20.445005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port fd42b73f-bf14-484c-8d39-4446ddb373b6 updated. Details: {'device': 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3408b8b1-1a84-4fa0-8af6-da7419c2525d', 'network_id': '3408b8b1-1a84-4fa0-8af6-da7419c2525d', 'port_id': 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'mac_address': 'fa:16:3e:63:9f:1d', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 367, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '17feeb99-a150-43e4-9bdf-e5689885a334', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:51:20.445005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 11 as local vlan for net-id=3408b8b1-1a84-4fa0-8af6-da7419c2525d, seg-id=367 Sep 30 09:51:20.447157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xc9105efe,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4463), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:20.449472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xf1c0510,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4107)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4463}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:20.450557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfd42b73f-bf, col_values=(('tag', 11),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:20.451013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapfd42b73f-bf, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:20.451510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapfd42b73f-bf, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:20.458443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfd42b73f-bf, col_values=(('other_config', {'net_uuid': '3408b8b1-1a84-4fa0-8af6-da7419c2525d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '367'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:20.465277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0512,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:20.465631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:413 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.026 Sep 30 09:51:20.466012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:51:20.466379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'fd42b73f-bf14-484c-8d39-4446ddb373b6'} Sep 30 09:51:20.467691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:51:20.467975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:51:20.472130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:20.523209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3497d744-9122-4563-b846-b024544cb1f6]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:20.524046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:413 - agent port security group processed in 0.084 Sep 30 09:51:20.524819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for fd42b73f-bf14-484c-8d39-4446ddb373b6 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:51:20.795597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['fd42b73f-bf14-484c-8d39-4446ddb373b6'] and devices down [] completed. Sep 30 09:51:20.796559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:413 - ports processed. Elapsed:0.368 Sep 30 09:51:20.796892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:413 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.368 Sep 30 09:51:20.924875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port fd42b73f-bf14-484c-8d39-4446ddb373b6 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:20.925385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (fd42b73f-bf14-484c-8d39-4446ddb373b6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:22.038072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8ba8040f-e313-48f1-997a-eee6d9d4397a None None] Resource Port 6c896384-3d9b-4662-a8e4-e5f3e48a43bc updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=6c896384-3d9b-4662-a8e4-e5f3e48a43bc,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6c896384-3d9b-4662-a8e4-e5f3e48a43bc,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:22.040641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8ba8040f-e313-48f1-997a-eee6d9d4397a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6c896384-3d9b-4662-a8e4-e5f3e48a43bc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:22.296794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8ba8040f-e313-48f1-997a-eee6d9d4397a None None] Resource Port 6c896384-3d9b-4662-a8e4-e5f3e48a43bc updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6c896384-3d9b-4662-a8e4-e5f3e48a43bc,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6c896384-3d9b-4662-a8e4-e5f3e48a43bc,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6c896384-3d9b-4662-a8e4-e5f3e48a43bc,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:22.297557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8ba8040f-e313-48f1-997a-eee6d9d4397a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6c896384-3d9b-4662-a8e4-e5f3e48a43bc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:22.399531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e420b372-489f-4006-8926-6df56ee29294 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:51:21Z,data_plane_status=None,description='',device_id='a4e40616-4f27-407b-b1db-b2c3393c44d2',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=fbf021f9-ae35-47af-9243-953bba459691,mac_address=fa:16:3e:15:54:bc,name='',network_id=3408b8b1-1a84-4fa0-8af6-da7419c2525d,numa_affinity_policy=,project_id='f0d0c96bbb304882b1f2459361551a93',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(fbf021f9-ae35-47af-9243-953bba459691),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:51:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:22.400147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e420b372-489f-4006-8926-6df56ee29294 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (fbf021f9-ae35-47af-9243-953bba459691), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:22.434788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:414 started Sep 30 09:51:22.443906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0514,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=938000000,duration_sec=840,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:22.444576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:22.444956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:414 - starting polling. Elapsed:0.010 Sep 30 09:51:22.453710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:22.458720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:414 - port information retrieved. Elapsed:0.024 Sep 30 09:51:22.459593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': set(), 'updated': {'fd42b73f-bf14-484c-8d39-4446ddb373b6'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:22.461216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3408b8b1-1a84-4fa0-8af6-da7419c2525d', 'network_id': '3408b8b1-1a84-4fa0-8af6-da7419c2525d', 'port_id': 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'mac_address': 'fa:16:3e:63:9f:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 367, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '17feeb99-a150-43e4-9bdf-e5689885a334', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:51:22.467138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: fd42b73f-bf14-484c-8d39-4446ddb373b6 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:51:22.467697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port fd42b73f-bf14-484c-8d39-4446ddb373b6 updated. Details: {'device': 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-3408b8b1-1a84-4fa0-8af6-da7419c2525d', 'network_id': '3408b8b1-1a84-4fa0-8af6-da7419c2525d', 'port_id': 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'mac_address': 'fa:16:3e:63:9f:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 367, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '17feeb99-a150-43e4-9bdf-e5689885a334', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Sep 30 09:51:22.468982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfd42b73f-bf, col_values=(('tag', 11),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:22.469684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapfd42b73f-bf, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:22.470822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapfd42b73f-bf, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:22.471668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:51:22.474018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapfd42b73f-bf, col_values=(('other_config', {'net_uuid': '3408b8b1-1a84-4fa0-8af6-da7419c2525d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '367', 'tag': '11'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:22.475600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:51:22.480722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0516,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:22.482890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:414 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 17 devices currently available. Time elapsed: 0.023 Sep 30 09:51:22.483257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:51:22.483549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:51:22.489205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:51:22.489716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:51:22.500763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:22.561975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[263ad91a-6fd6-4418-aab5-b2e871e8d7c3]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:22.562875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:414 - agent port security group processed in 0.103 Sep 30 09:51:22.563872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for fd42b73f-bf14-484c-8d39-4446ddb373b6 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:51:22.752170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['fd42b73f-bf14-484c-8d39-4446ddb373b6'] and devices down [] completed. Sep 30 09:51:22.752523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:414 - ports processed. Elapsed:0.318 Sep 30 09:51:22.752863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:414 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.318 Sep 30 09:51:22.909269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3e6a7f60-0ce8-4f9d-91eb-0777c238318b","insert","qg-6c896384-3d",["set",[]],["map",[["attached-mac","fa:16:3e:1a:74:6e"],["iface-id","6c896384-3d9b-4662-a8e4-e5f3e48a43bc"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:22.928995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3e6a7f60-0ce8-4f9d-91eb-0777c238318b","old",null,["set",[]],null],["","new","qg-6c896384-3d",28,["map",[["attached-mac","fa:16:3e:1a:74:6e"],["iface-id","6c896384-3d9b-4662-a8e4-e5f3e48a43bc"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:23.002793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c74482a9-d183-4a1b-bdae-7d00a85b4cb1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Resource Port deleted: 411b31d5-4a9b-44b2-8ce8-22d9cb075ef9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:23.003486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c74482a9-d183-4a1b-bdae-7d00a85b4cb1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (411b31d5-4a9b-44b2-8ce8-22d9cb075ef9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:23.004019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-c74482a9-d183-4a1b-bdae-7d00a85b4cb1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group member updated {'282fb47d-342a-46a3-b176-f701ce385057'} Sep 30 09:51:23.145722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e420b372-489f-4006-8926-6df56ee29294 admin admin] Received resource Port update without any changes: fbf021f9-ae35-47af-9243-953bba459691 {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 30 09:51:24.435702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:415 started Sep 30 09:51:24.438956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0518,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=938000000,duration_sec=842,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:24.440065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:24.440523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:415 - starting polling. Elapsed:0.005 Sep 30 09:51:24.443187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:24.445474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 411b31d5-4a9b-44b2-8ce8-22d9cb075ef9 not present in bridge br-int Sep 30 09:51:24.449527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:51:24.449527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['411b31d5-4a9b-44b2-8ce8-22d9cb075ef9'] Sep 30 09:51:24.449527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 411b31d5-4a9b-44b2-8ce8-22d9cb075ef9 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:51:24.451020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:415 - port information retrieved. Elapsed:0.015 Sep 30 09:51:24.451356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': {'6c896384-3d9b-4662-a8e4-e5f3e48a43bc'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:24.451947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', 'device_id': 'a4e40616-4f27-407b-b1db-b2c3393c44d2', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', 'mac_address': 'fa:16:3e:1a:74:6e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.202'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:51:24.455127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 6c896384-3d9b-4662-a8e4-e5f3e48a43bc {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:51:24.456624 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 6c896384-3d9b-4662-a8e4-e5f3e48a43bc updated. Details: {'device': '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', 'device_id': 'a4e40616-4f27-407b-b1db-b2c3393c44d2', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', 'mac_address': 'fa:16:3e:1a:74:6e', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.202'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:51:24.458029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-6c896384-3d, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:24.458698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-6c896384-3d, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:24.459282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-6c896384-3d, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:24.469006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-6c896384-3d, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:24.485239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c051a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:24.485905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:415 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 18 devices currently available. Time elapsed: 0.034 Sep 30 09:51:24.486502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:51:24.486636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'6c896384-3d9b-4662-a8e4-e5f3e48a43bc'} Sep 30 09:51:24.487896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:51:24.488247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:51:24.493382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:24.534765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c7c593-5b59-43de-89af-104f6a2eb4ae]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:24.536772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:415 - agent port security group processed in 0.084 Sep 30 09:51:24.536772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 6c896384-3d9b-4662-a8e4-e5f3e48a43bc to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:51:24.781754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['6c896384-3d9b-4662-a8e4-e5f3e48a43bc'] and devices down [] completed. Sep 30 09:51:24.782080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:415 - ports processed. Elapsed:0.347 Sep 30 09:51:24.782416 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:415 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.347 Sep 30 09:51:24.808424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:51:24Z,description='Default security group',id=c282cf4a-ae93-4666-b35f-ef2541fbedd4,is_default=True,name='default',project_id='8003aa7a2df842bb92467d64e17bab8d',revision_number=1,rules=[SecurityGroupRule(2667f47f-6af9-4e0a-b9cc-a98bae117b58),SecurityGroupRule(9c2618c4-5b2f-47e7-a2ab-7e1bc18af883),SecurityGroupRule(a2ff853c-9ba2-4c83-815d-20c0897f459e),SecurityGroupRule(c6474172-4f0a-4bcb-9530-57b98f8f8994)],shared=False,stateful=True,updated_at=2022-09-30T09:51:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:24.808805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (c282cf4a-ae93-4666-b35f-ef2541fbedd4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:24.809436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:24Z,description=,direction='egress',ethertype='IPv6',id=2667f47f-6af9-4e0a-b9cc-a98bae117b58,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8003aa7a2df842bb92467d64e17bab8d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c282cf4a-ae93-4666-b35f-ef2541fbedd4,updated_at=2022-09-30T09:51:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:24.809800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2667f47f-6af9-4e0a-b9cc-a98bae117b58), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:24.810233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Security group rule updated ['c282cf4a-ae93-4666-b35f-ef2541fbedd4'] Sep 30 09:51:24.810836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:24Z,description=,direction='ingress',ethertype='IPv6',id=9c2618c4-5b2f-47e7-a2ab-7e1bc18af883,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8003aa7a2df842bb92467d64e17bab8d',protocol=,remote_address_group_id=,remote_group_id=c282cf4a-ae93-4666-b35f-ef2541fbedd4,remote_ip_prefix=,revision_number=0,security_group_id=c282cf4a-ae93-4666-b35f-ef2541fbedd4,updated_at=2022-09-30T09:51:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:24.811198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (9c2618c4-5b2f-47e7-a2ab-7e1bc18af883), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:24.811527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Security group rule updated ['c282cf4a-ae93-4666-b35f-ef2541fbedd4'] Sep 30 09:51:24.812193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:24Z,description=,direction='ingress',ethertype='IPv4',id=a2ff853c-9ba2-4c83-815d-20c0897f459e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8003aa7a2df842bb92467d64e17bab8d',protocol=,remote_address_group_id=,remote_group_id=c282cf4a-ae93-4666-b35f-ef2541fbedd4,remote_ip_prefix=,revision_number=0,security_group_id=c282cf4a-ae93-4666-b35f-ef2541fbedd4,updated_at=2022-09-30T09:51:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:24.812906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a2ff853c-9ba2-4c83-815d-20c0897f459e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:24.812906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Security group rule updated ['c282cf4a-ae93-4666-b35f-ef2541fbedd4'] Sep 30 09:51:24.813515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:24Z,description=,direction='egress',ethertype='IPv4',id=c6474172-4f0a-4bcb-9530-57b98f8f8994,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8003aa7a2df842bb92467d64e17bab8d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c282cf4a-ae93-4666-b35f-ef2541fbedd4,updated_at=2022-09-30T09:51:24Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:24.813869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c6474172-4f0a-4bcb-9530-57b98f8f8994), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:24.814223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Security group rule updated ['c282cf4a-ae93-4666-b35f-ef2541fbedd4'] Sep 30 09:51:24.856945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port 6c896384-3d9b-4662-a8e4-e5f3e48a43bc updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6c896384-3d9b-4662-a8e4-e5f3e48a43bc,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6c896384-3d9b-4662-a8e4-e5f3e48a43bc,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:24.858044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6c896384-3d9b-4662-a8e4-e5f3e48a43bc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:25.036957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:51:24Z,description='',dns_domain=None,id=a1a947f8-b8f0-49fd-a3af-298fa4634634,mtu=1500,name='tempest-TestVolumeBootPattern-129688495-network',project_id='8003aa7a2df842bb92467d64e17bab8d',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(a1a947f8-b8f0-49fd-a3af-298fa4634634),segments=[NetworkSegment(29d35d8c-7493-42ed-bdc4-47ecd13225b0)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:51:24Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:25.037337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (a1a947f8-b8f0-49fd-a3af-298fa4634634), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:25.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-873836f7-3cfd-408d-a7bd-7d575a69eec7 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network a1a947f8-b8f0-49fd-a3af-298fa4634634 with segmentation id not found. Sep 30 09:51:25.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:51:25.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:51:25.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:51:25.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:51:25.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:51:25.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:51:25.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:51:25.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:51:25.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:51:25.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:51:25.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:51:25.154446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:51:25.155494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:51:25.155494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:51:25.155494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:51:25.155494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network a1a947f8-b8f0-49fd-a3af-298fa4634634 with segmentation id not found. Sep 30 09:51:25.155494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:51:25.532716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2e50b9d3-2486-4bfe-8a70-6b6a460b595e admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(c15947a3-2058-492d-975f-ef456c3e0300)],cidr=172.20.0.0/28,created_at=2022-09-30T09:51:25Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=248eeeb2-071e-427b-b827-6d99e6e35d4e,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-TestVolumeBootPattern-129688495-subnet',network_id=a1a947f8-b8f0-49fd-a3af-298fa4634634,project_id='8003aa7a2df842bb92467d64e17bab8d',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:51:25Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:25.533336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2e50b9d3-2486-4bfe-8a70-6b6a460b595e admin admin] Publish callbacks [] for Subnet (248eeeb2-071e-427b-b827-6d99e6e35d4e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:25.880923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e7fb12b4-700e-4ecc-b9f3-4b54d69c820d None None] Resource Port fbf021f9-ae35-47af-9243-953bba459691 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=fbf021f9-ae35-47af-9243-953bba459691,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fbf021f9-ae35-47af-9243-953bba459691,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:25.881315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e7fb12b4-700e-4ecc-b9f3-4b54d69c820d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (fbf021f9-ae35-47af-9243-953bba459691), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:26.436673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:416 started Sep 30 09:51:26.442295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c051c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=940000000,duration_sec=844,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:26.443017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:26.443365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:416 - starting polling. Elapsed:0.007 Sep 30 09:51:26.446854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:26.450634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:416 - port information retrieved. Elapsed:0.014 Sep 30 09:51:26.451061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': set(), 'updated': {'6c896384-3d9b-4662-a8e4-e5f3e48a43bc'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:26.455031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', 'device_id': 'a4e40616-4f27-407b-b1db-b2c3393c44d2', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', 'mac_address': 'fa:16:3e:1a:74:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.202'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:51:26.465069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 6c896384-3d9b-4662-a8e4-e5f3e48a43bc {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:51:26.465428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 6c896384-3d9b-4662-a8e4-e5f3e48a43bc updated. Details: {'device': '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', 'device_id': 'a4e40616-4f27-407b-b1db-b2c3393c44d2', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', 'mac_address': 'fa:16:3e:1a:74:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.202'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:51:26.468115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-6c896384-3d, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:26.468843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-6c896384-3d, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:26.469459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-6c896384-3d, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:26.470479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:51:26.483946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-6c896384-3d, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:26.486273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:51:26.492434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c051e,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:26.494410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:416 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 18 devices currently available. Time elapsed: 0.043 Sep 30 09:51:26.495772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:51:26.497090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:51:26.500258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:51:26.500548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:51:26.509775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:26.583775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[1571ea4b-cc94-4f3d-ba73-4d6eff434a20]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:26.584470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:416 - agent port security group processed in 0.133 Sep 30 09:51:26.585625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 6c896384-3d9b-4662-a8e4-e5f3e48a43bc to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:51:26.630846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e7fb12b4-700e-4ecc-b9f3-4b54d69c820d None None] Resource Port fbf021f9-ae35-47af-9243-953bba459691 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fbf021f9-ae35-47af-9243-953bba459691,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=fbf021f9-ae35-47af-9243-953bba459691,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=fbf021f9-ae35-47af-9243-953bba459691,segment=NetworkSegment(765b8827-dc41-4d9e-be01-6115a3b03c81),segment_id=765b8827-dc41-4d9e-be01-6115a3b03c81)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:26.631290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e7fb12b4-700e-4ecc-b9f3-4b54d69c820d None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (fbf021f9-ae35-47af-9243-953bba459691), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:26.850536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-743c7cf0-f92f-4222-a20b-ec0a35e9d5a0 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:51:25Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a1a947f8-b8f0-49fd-a3af-298fa4634634',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6b6494e4-74c0-498e-9e7b-c0a784d5ff48,mac_address=fa:16:3e:01:ac:7c,name='',network_id=a1a947f8-b8f0-49fd-a3af-298fa4634634,numa_affinity_policy=,project_id='8003aa7a2df842bb92467d64e17bab8d',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6b6494e4-74c0-498e-9e7b-c0a784d5ff48),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:51:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:26.851572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-743c7cf0-f92f-4222-a20b-ec0a35e9d5a0 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6b6494e4-74c0-498e-9e7b-c0a784d5ff48), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:27.023469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4b3be73e-ef91-40c5-b16e-752a6688529c admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:51:26Z,data_plane_status=None,description='',device_id='ac100cf4-eb69-49ba-85aa-88dc3eb1115d',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=e87f42eb-c1d9-464e-aa60-6d70059896bb,mac_address=fa:16:3e:27:2d:c2,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(e87f42eb-c1d9-464e-aa60-6d70059896bb),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:51:26Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:27.024434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4b3be73e-ef91-40c5-b16e-752a6688529c admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (e87f42eb-c1d9-464e-aa60-6d70059896bb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:27.196392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['6c896384-3d9b-4662-a8e4-e5f3e48a43bc'] and devices down [] completed. Sep 30 09:51:27.196392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:416 - ports processed. Elapsed:0.751 Sep 30 09:51:27.196392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:416 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.752 Sep 30 09:51:27.358537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c173908b-eba2-4eb7-b6ce-ddf30417554c None None] Resource Port fbf021f9-ae35-47af-9243-953bba459691 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:27.359107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c173908b-eba2-4eb7-b6ce-ddf30417554c None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (fbf021f9-ae35-47af-9243-953bba459691), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:27.397377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["80b98fcc-27bd-476c-9a64-e13ea321b5aa","insert","qr-fbf021f9-ae",["set",[]],["map",[["attached-mac","fa:16:3e:15:54:bc"],["iface-id","fbf021f9-ae35-47af-9243-953bba459691"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:27.445027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["80b98fcc-27bd-476c-9a64-e13ea321b5aa","old",null,["set",[]],null],["","new","qr-fbf021f9-ae",29,["map",[["attached-mac","fa:16:3e:15:54:bc"],["iface-id","fbf021f9-ae35-47af-9243-953bba459691"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:27.602498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-743c7cf0-f92f-4222-a20b-ec0a35e9d5a0 None None] Resource Port 6b6494e4-74c0-498e-9e7b-c0a784d5ff48 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6b6494e4-74c0-498e-9e7b-c0a784d5ff48,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6b6494e4-74c0-498e-9e7b-c0a784d5ff48,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6b6494e4-74c0-498e-9e7b-c0a784d5ff48,segment=NetworkSegment(29d35d8c-7493-42ed-bdc4-47ecd13225b0),segment_id=29d35d8c-7493-42ed-bdc4-47ecd13225b0)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:27.603235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-743c7cf0-f92f-4222-a20b-ec0a35e9d5a0 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6b6494e4-74c0-498e-9e7b-c0a784d5ff48), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:27.673554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5d9bb344-6210-4e7d-8e3b-78301c60af9a","insert","tap6b6494e4-74",["set",[]],["map",[["attached-mac","fa:16:3e:01:ac:7c"],["iface-id","6b6494e4-74c0-498e-9e7b-c0a784d5ff48"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:27.697343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5d9bb344-6210-4e7d-8e3b-78301c60af9a","old",null,["set",[]],null],["","new","tap6b6494e4-74",30,["map",[["attached-mac","fa:16:3e:01:ac:7c"],["iface-id","6b6494e4-74c0-498e-9e7b-c0a784d5ff48"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:28.437231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:417 started Sep 30 09:51:28.441404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0520,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=940000000,duration_sec=846,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:28.441997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:28.442549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:417 - starting polling. Elapsed:0.005 Sep 30 09:51:28.446713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:28.450515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:417 - port information retrieved. Elapsed:0.013 Sep 30 09:51:28.452687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'fbf021f9-ae35-47af-9243-953bba459691'}, 'removed': set(), 'updated': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'fbf021f9-ae35-47af-9243-953bba459691'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:28.453448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a1a947f8-b8f0-49fd-a3af-298fa4634634', 'network_id': 'a1a947f8-b8f0-49fd-a3af-298fa4634634', 'port_id': '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'mac_address': 'fa:16:3e:01:ac:7c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '248eeeb2-071e-427b-b827-6d99e6e35d4e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:51:28.457445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'fbf021f9-ae35-47af-9243-953bba459691', 'device_id': 'a4e40616-4f27-407b-b1db-b2c3393c44d2', 'network_id': '3408b8b1-1a84-4fa0-8af6-da7419c2525d', 'port_id': 'fbf021f9-ae35-47af-9243-953bba459691', 'mac_address': 'fa:16:3e:15:54:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 367, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '17feeb99-a150-43e4-9bdf-e5689885a334', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:51:28.465458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 6b6494e4-74c0-498e-9e7b-c0a784d5ff48 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:51:28.471144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 6b6494e4-74c0-498e-9e7b-c0a784d5ff48 updated. Details: {'device': '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a1a947f8-b8f0-49fd-a3af-298fa4634634', 'network_id': 'a1a947f8-b8f0-49fd-a3af-298fa4634634', 'port_id': '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'mac_address': 'fa:16:3e:01:ac:7c', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '248eeeb2-071e-427b-b827-6d99e6e35d4e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:51:28.472471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 12 as local vlan for net-id=a1a947f8-b8f0-49fd-a3af-298fa4634634, seg-id=350 Sep 30 09:51:28.488874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xc9105f00,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4446), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:28.498404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xf1c0522,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4108)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4446}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:28.499973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6b6494e4-74, col_values=(('tag', 12),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:28.500801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap6b6494e4-74, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:28.501554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap6b6494e4-74, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:28.516834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6b6494e4-74, col_values=(('other_config', {'net_uuid': 'a1a947f8-b8f0-49fd-a3af-298fa4634634', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '350'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:28.536024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0524,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:28.536589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: fbf021f9-ae35-47af-9243-953bba459691 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:51:28.537009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port fbf021f9-ae35-47af-9243-953bba459691 updated. Details: {'device': 'fbf021f9-ae35-47af-9243-953bba459691', 'device_id': 'a4e40616-4f27-407b-b1db-b2c3393c44d2', 'network_id': '3408b8b1-1a84-4fa0-8af6-da7419c2525d', 'port_id': 'fbf021f9-ae35-47af-9243-953bba459691', 'mac_address': 'fa:16:3e:15:54:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 367, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '17feeb99-a150-43e4-9bdf-e5689885a334', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 11} Sep 30 09:51:28.538071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-fbf021f9-ae, col_values=(('tag', 11),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:28.539307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-fbf021f9-ae, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:28.540460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-fbf021f9-ae, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:28.560639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-fbf021f9-ae, col_values=(('other_config', {'net_uuid': '3408b8b1-1a84-4fa0-8af6-da7419c2525d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '11', 'segmentation_id': '367'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:28.575713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0526,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:28.576438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:417 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.123 Sep 30 09:51:28.580397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 2 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:51:28.581668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'fbf021f9-ae35-47af-9243-953bba459691'} Sep 30 09:51:28.583732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:51:28.584276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:51:28.590157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:28.687248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5a65e5-d4b8-4fe3-9a83-91af5b6b4fa0]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:28.688057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:417 - agent port security group processed in 0.235 Sep 30 09:51:28.689062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 6b6494e4-74c0-498e-9e7b-c0a784d5ff48 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:51:28.689460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for fbf021f9-ae35-47af-9243-953bba459691 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:51:28.780254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Resource SecurityGroup deleted: 282fb47d-342a-46a3-b176-f701ce385057 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:28.782005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (282fb47d-342a-46a3-b176-f701ce385057), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:28.782005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('282fb47d-342a-46a3-b176-f701ce385057',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:51:28.891810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('282fb47d-342a-46a3-b176-f701ce385057',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:51:28.895095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Resource SecurityGroupRule deleted: 11680eeb-2c3d-44dd-b243-bc4d57c6a857 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:28.895095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (11680eeb-2c3d-44dd-b243-bc4d57c6a857), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:28.895095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group rule updated ['282fb47d-342a-46a3-b176-f701ce385057'] Sep 30 09:51:28.895095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Resource SecurityGroupRule deleted: 5f45f8b7-fbb9-41cd-9309-e820f7714180 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:28.895499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5f45f8b7-fbb9-41cd-9309-e820f7714180), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:28.895499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group rule updated ['282fb47d-342a-46a3-b176-f701ce385057'] Sep 30 09:51:28.895499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Resource SecurityGroupRule deleted: 3e59c42d-713b-4b60-8cd2-af1266337bb7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:28.895499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (3e59c42d-713b-4b60-8cd2-af1266337bb7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:28.895851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group rule updated ['282fb47d-342a-46a3-b176-f701ce385057'] Sep 30 09:51:28.896552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Resource SecurityGroupRule deleted: d5c79a47-8cc6-432e-a1cc-0556b3f93a38 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:28.897132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d5c79a47-8cc6-432e-a1cc-0556b3f93a38), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:28.897698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-33ae56c0-4809-4fee-9cca-a30db71fe7a1 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group rule updated ['282fb47d-342a-46a3-b176-f701ce385057'] Sep 30 09:51:29.367878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9694055c-4196-405a-9b96-57bab8921448 None None] Resource Port 6b6494e4-74c0-498e-9e7b-c0a784d5ff48 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:29.368262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9694055c-4196-405a-9b96-57bab8921448 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6b6494e4-74c0-498e-9e7b-c0a784d5ff48), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:29.431203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-387a98be-2ba0-419e-befc-17e881daa9a9 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Resource Port deleted: 20848721-b1f2-4bdb-8d73-5b4e002189fa {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:29.432373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-387a98be-2ba0-419e-befc-17e881daa9a9 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (20848721-b1f2-4bdb-8d73-5b4e002189fa), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:29.463970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5cd8f022-600e-40e2-bb05-50bb892ca141 None None] Resource Port e87f42eb-c1d9-464e-aa60-6d70059896bb updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=e87f42eb-c1d9-464e-aa60-6d70059896bb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e87f42eb-c1d9-464e-aa60-6d70059896bb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:29.464266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5cd8f022-600e-40e2-bb05-50bb892ca141 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (e87f42eb-c1d9-464e-aa60-6d70059896bb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:29.698332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-556a6f78-1d43-40d0-abc0-04278089e8d0 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:51:29Z,data_plane_status=None,description='',device_id='ac100cf4-eb69-49ba-85aa-88dc3eb1115d',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=2aec6d92-a4cd-4845-88ae-1b87a008cc45,mac_address=fa:16:3e:c9:b1:ae,name='',network_id=a1a947f8-b8f0-49fd-a3af-298fa4634634,numa_affinity_policy=,project_id='8003aa7a2df842bb92467d64e17bab8d',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(2aec6d92-a4cd-4845-88ae-1b87a008cc45),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:51:29Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:29.699448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-556a6f78-1d43-40d0-abc0-04278089e8d0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (2aec6d92-a4cd-4845-88ae-1b87a008cc45), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:29.776594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5cd8f022-600e-40e2-bb05-50bb892ca141 None None] Resource Port e87f42eb-c1d9-464e-aa60-6d70059896bb updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e87f42eb-c1d9-464e-aa60-6d70059896bb,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=e87f42eb-c1d9-464e-aa60-6d70059896bb,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e87f42eb-c1d9-464e-aa60-6d70059896bb,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:29.777015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5cd8f022-600e-40e2-bb05-50bb892ca141 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (e87f42eb-c1d9-464e-aa60-6d70059896bb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:30.254168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'fbf021f9-ae35-47af-9243-953bba459691'] and devices down [] completed. Sep 30 09:51:30.254584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:417 - ports processed. Elapsed:1.817 Sep 30 09:51:30.255123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:417 completed. Processed ports statistics: {'regular': {'added': 2, 'updated': 2, 'removed': 0}}. Elapsed:1.818 Sep 30 09:51:30.395543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a44df361-4490-4dd6-a6da-3b88699a1b7f","insert","qg-e87f42eb-c1",["set",[]],["map",[["attached-mac","fa:16:3e:27:2d:c2"],["iface-id","e87f42eb-c1d9-464e-aa60-6d70059896bb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:30.410821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a44df361-4490-4dd6-a6da-3b88699a1b7f","old",null,["set",[]],null],["","new","qg-e87f42eb-c1",31,["map",[["attached-mac","fa:16:3e:27:2d:c2"],["iface-id","e87f42eb-c1d9-464e-aa60-6d70059896bb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:30.438800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:418 started Sep 30 09:51:30.441910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0528,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=941000000,duration_sec=848,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:30.442740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:30.443146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:418 - starting polling. Elapsed:0.005 Sep 30 09:51:30.445990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:30.447939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 20848721-b1f2-4bdb-8d73-5b4e002189fa not present in bridge br-int Sep 30 09:51:30.448279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:51:30.448565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['20848721-b1f2-4bdb-8d73-5b4e002189fa'] Sep 30 09:51:30.448896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 20848721-b1f2-4bdb-8d73-5b4e002189fa is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:51:30.455558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:418 - port information retrieved. Elapsed:0.017 Sep 30 09:51:30.455989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': {'e87f42eb-c1d9-464e-aa60-6d70059896bb'}, 'removed': set(), 'updated': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'e87f42eb-c1d9-464e-aa60-6d70059896bb'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:30.458827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a1a947f8-b8f0-49fd-a3af-298fa4634634', 'network_id': 'a1a947f8-b8f0-49fd-a3af-298fa4634634', 'port_id': '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'mac_address': 'fa:16:3e:01:ac:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '248eeeb2-071e-427b-b827-6d99e6e35d4e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:51:30.459620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'device_id': 'ac100cf4-eb69-49ba-85aa-88dc3eb1115d', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'mac_address': 'fa:16:3e:27:2d:c2', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.46'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:51:30.464384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 6b6494e4-74c0-498e-9e7b-c0a784d5ff48 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:51:30.464730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 6b6494e4-74c0-498e-9e7b-c0a784d5ff48 updated. Details: {'device': '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-a1a947f8-b8f0-49fd-a3af-298fa4634634', 'network_id': 'a1a947f8-b8f0-49fd-a3af-298fa4634634', 'port_id': '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'mac_address': 'fa:16:3e:01:ac:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '248eeeb2-071e-427b-b827-6d99e6e35d4e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Sep 30 09:51:30.475796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6b6494e4-74, col_values=(('tag', 12),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:30.476805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap6b6494e4-74, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:30.477212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap6b6494e4-74, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:30.477661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:51:30.478772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap6b6494e4-74, col_values=(('other_config', {'net_uuid': 'a1a947f8-b8f0-49fd-a3af-298fa4634634', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '350', 'tag': '12'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:30.479470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:51:30.481845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c052a,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:30.482399 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: e87f42eb-c1d9-464e-aa60-6d70059896bb {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:51:30.482807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port e87f42eb-c1d9-464e-aa60-6d70059896bb updated. Details: {'device': 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'device_id': 'ac100cf4-eb69-49ba-85aa-88dc3eb1115d', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'mac_address': 'fa:16:3e:27:2d:c2', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.46'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:51:30.483835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e87f42eb-c1, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:30.484184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-e87f42eb-c1, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:30.484804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-e87f42eb-c1, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:30.495124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e87f42eb-c1, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:30.505786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c052c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:30.506378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:418 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 21 devices currently available. Time elapsed: 0.050 Sep 30 09:51:30.506851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:51:30.507190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'e87f42eb-c1d9-464e-aa60-6d70059896bb'} Sep 30 09:51:30.508366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:51:30.508647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:51:30.513972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:30.575689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b724598-ebaf-4bab-9e6c-19039ca49ff8]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:30.576433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:51:30.576838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:51:30.578227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:51:30.578580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:51:30.583435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:30.624234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-556a6f78-1d43-40d0-abc0-04278089e8d0 admin admin] Received resource Port update without any changes: 2aec6d92-a4cd-4845-88ae-1b87a008cc45 {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 30 09:51:30.644817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f97cb47-2ecf-4fb6-9059-294fbe0be005]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:30.645477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:418 - agent port security group processed in 0.189 Sep 30 09:51:30.646699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 6b6494e4-74c0-498e-9e7b-c0a784d5ff48 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:51:30.647002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for e87f42eb-c1d9-464e-aa60-6d70059896bb to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:51:31.129782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'e87f42eb-c1d9-464e-aa60-6d70059896bb'] and devices down [] completed. Sep 30 09:51:31.130407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:418 - ports processed. Elapsed:0.692 Sep 30 09:51:31.130407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:418 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 2, 'removed': 0}}. Elapsed:0.692 Sep 30 09:51:31.223058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port e87f42eb-c1d9-464e-aa60-6d70059896bb updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e87f42eb-c1d9-464e-aa60-6d70059896bb,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=e87f42eb-c1d9-464e-aa60-6d70059896bb,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:31.225130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (e87f42eb-c1d9-464e-aa60-6d70059896bb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:31.798228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ad59bd06-e6c8-45d5-804f-86c33f6554bd tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:51:31Z,description='tempest-secgroup-smoke-844905994 description',id=6fa83794-f114-4d02-9d65-747e3bcbcdb0,is_default=False,name='tempest-secgroup-smoke-844905994',project_id='f0d0c96bbb304882b1f2459361551a93',revision_number=1,rules=[SecurityGroupRule(1548a533-d7cc-48d6-87f8-940e7f7c3e91),SecurityGroupRule(8ab893a1-4ce2-4b9a-9727-11c6a5a43e37)],shared=False,stateful=True,updated_at=2022-09-30T09:51:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:31.798638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ad59bd06-e6c8-45d5-804f-86c33f6554bd tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (6fa83794-f114-4d02-9d65-747e3bcbcdb0), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:31.799304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ad59bd06-e6c8-45d5-804f-86c33f6554bd tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:31Z,description=,direction='egress',ethertype='IPv4',id=1548a533-d7cc-48d6-87f8-940e7f7c3e91,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f0d0c96bbb304882b1f2459361551a93',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6fa83794-f114-4d02-9d65-747e3bcbcdb0,updated_at=2022-09-30T09:51:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:31.799669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ad59bd06-e6c8-45d5-804f-86c33f6554bd tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (1548a533-d7cc-48d6-87f8-940e7f7c3e91), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:31.800007 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ad59bd06-e6c8-45d5-804f-86c33f6554bd tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:51:31.800691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ad59bd06-e6c8-45d5-804f-86c33f6554bd tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:31Z,description=,direction='egress',ethertype='IPv6',id=8ab893a1-4ce2-4b9a-9727-11c6a5a43e37,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f0d0c96bbb304882b1f2459361551a93',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6fa83794-f114-4d02-9d65-747e3bcbcdb0,updated_at=2022-09-30T09:51:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:31.801046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ad59bd06-e6c8-45d5-804f-86c33f6554bd tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8ab893a1-4ce2-4b9a-9727-11c6a5a43e37), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:31.801375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ad59bd06-e6c8-45d5-804f-86c33f6554bd tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:51:32.083743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3f6a20fd-9682-4565-acd9-0fbf6dce3804 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:31Z,description='',direction='ingress',ethertype='IPv4',id=957a22ae-98bc-4e9b-8bfc-9a0443f3351e,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f0d0c96bbb304882b1f2459361551a93',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6fa83794-f114-4d02-9d65-747e3bcbcdb0,updated_at=2022-09-30T09:51:31Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:32.084151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3f6a20fd-9682-4565-acd9-0fbf6dce3804 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (957a22ae-98bc-4e9b-8bfc-9a0443f3351e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:32.084488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3f6a20fd-9682-4565-acd9-0fbf6dce3804 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:51:32.438391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-facf4193-ff29-481d-a4b2-204abc63c23a tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:32Z,description='',direction='egress',ethertype='IPv4',id=fb902209-0d2d-4707-9fc9-2733d28dabf5,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='f0d0c96bbb304882b1f2459361551a93',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6fa83794-f114-4d02-9d65-747e3bcbcdb0,updated_at=2022-09-30T09:51:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:32.439147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-facf4193-ff29-481d-a4b2-204abc63c23a tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (fb902209-0d2d-4707-9fc9-2733d28dabf5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:32.439503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-facf4193-ff29-481d-a4b2-204abc63c23a tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:51:32.440427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:419 started Sep 30 09:51:32.442857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c052e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=943000000,duration_sec=850,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:32.443867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:32.444181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:419 - starting polling. Elapsed:0.004 Sep 30 09:51:32.455442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:32.459276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:419 - port information retrieved. Elapsed:0.019 Sep 30 09:51:32.459618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': set(), 'updated': {'e87f42eb-c1d9-464e-aa60-6d70059896bb'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:32.460297 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'device_id': 'ac100cf4-eb69-49ba-85aa-88dc3eb1115d', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'mac_address': 'fa:16:3e:27:2d:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.46'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:51:32.464527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: e87f42eb-c1d9-464e-aa60-6d70059896bb {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:51:32.464852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port e87f42eb-c1d9-464e-aa60-6d70059896bb updated. Details: {'device': 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'device_id': 'ac100cf4-eb69-49ba-85aa-88dc3eb1115d', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'mac_address': 'fa:16:3e:27:2d:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.46'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:51:32.465914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e87f42eb-c1, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:32.466335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-e87f42eb-c1, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:32.471503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-e87f42eb-c1, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:32.471941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:51:32.473191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-e87f42eb-c1, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:32.476803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:51:32.476803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0530,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:32.477289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:419 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 21 devices currently available. Time elapsed: 0.017 Sep 30 09:51:32.477553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:51:32.477838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:51:32.478993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:51:32.479272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:51:32.484156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:32.523948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2728a1e-d434-448f-985b-c500ebf872f7]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:32.524675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:419 - agent port security group processed in 0.065 Sep 30 09:51:32.525696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for e87f42eb-c1d9-464e-aa60-6d70059896bb to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:51:32.734396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['e87f42eb-c1d9-464e-aa60-6d70059896bb'] and devices down [] completed. Sep 30 09:51:32.734757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:419 - ports processed. Elapsed:0.294 Sep 30 09:51:32.735092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:419 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.295 Sep 30 09:51:32.862530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5531bbae-03d3-45b9-86e1-9d7c2e1745bb tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:32Z,description='',direction='ingress',ethertype='IPv4',id=7a1d4ae3-053b-4dbf-9d1a-e9d3773987b7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f0d0c96bbb304882b1f2459361551a93',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6fa83794-f114-4d02-9d65-747e3bcbcdb0,updated_at=2022-09-30T09:51:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:32.863176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5531bbae-03d3-45b9-86e1-9d7c2e1745bb tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7a1d4ae3-053b-4dbf-9d1a-e9d3773987b7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:32.863781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5531bbae-03d3-45b9-86e1-9d7c2e1745bb tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:51:32.869531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0b97dbc7-6afd-4c47-844d-e188d4fa2992 None None] Resource Port 2aec6d92-a4cd-4845-88ae-1b87a008cc45 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=2aec6d92-a4cd-4845-88ae-1b87a008cc45,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2aec6d92-a4cd-4845-88ae-1b87a008cc45,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:32.870311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0b97dbc7-6afd-4c47-844d-e188d4fa2992 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (2aec6d92-a4cd-4845-88ae-1b87a008cc45), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:33.229119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a8283bbf-23f2-4d09-ac62-e42c5d107a1b tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:33Z,description='',direction='egress',ethertype='IPv4',id=2a4bc5df-3aa0-4336-8845-9241a0b21505,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f0d0c96bbb304882b1f2459361551a93',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6fa83794-f114-4d02-9d65-747e3bcbcdb0,updated_at=2022-09-30T09:51:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:33.229637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a8283bbf-23f2-4d09-ac62-e42c5d107a1b tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2a4bc5df-3aa0-4336-8845-9241a0b21505), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:33.230042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a8283bbf-23f2-4d09-ac62-e42c5d107a1b tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:51:33.236421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0b97dbc7-6afd-4c47-844d-e188d4fa2992 None None] Resource Port 2aec6d92-a4cd-4845-88ae-1b87a008cc45 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2aec6d92-a4cd-4845-88ae-1b87a008cc45,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=2aec6d92-a4cd-4845-88ae-1b87a008cc45,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=2aec6d92-a4cd-4845-88ae-1b87a008cc45,segment=NetworkSegment(29d35d8c-7493-42ed-bdc4-47ecd13225b0),segment_id=29d35d8c-7493-42ed-bdc4-47ecd13225b0)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:33.236995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0b97dbc7-6afd-4c47-844d-e188d4fa2992 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (2aec6d92-a4cd-4845-88ae-1b87a008cc45), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:33.537732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d2a4f5a2-9348-4aba-9486-58de666ca78b","insert","qr-2aec6d92-a4",["set",[]],["map",[["attached-mac","fa:16:3e:c9:b1:ae"],["iface-id","2aec6d92-a4cd-4845-88ae-1b87a008cc45"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:33.549140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d2a4f5a2-9348-4aba-9486-58de666ca78b","old",null,["set",[]],null],["","new","qr-2aec6d92-a4",32,["map",[["attached-mac","fa:16:3e:c9:b1:ae"],["iface-id","2aec6d92-a4cd-4845-88ae-1b87a008cc45"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:33.593930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d6ee953f-40a8-4ab7-8264-c93649d9e2c9 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:33Z,description='',direction='ingress',ethertype='IPv6',id=c0f8d499-bf6f-443c-a5b2-1b33809f8ee1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f0d0c96bbb304882b1f2459361551a93',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6fa83794-f114-4d02-9d65-747e3bcbcdb0,updated_at=2022-09-30T09:51:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:33.602733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d6ee953f-40a8-4ab7-8264-c93649d9e2c9 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c0f8d499-bf6f-443c-a5b2-1b33809f8ee1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:33.602733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d6ee953f-40a8-4ab7-8264-c93649d9e2c9 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:51:33.807627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-aa9bd003-afd9-417b-ac65-f0ecc0e74151 None None] Resource Port 2aec6d92-a4cd-4845-88ae-1b87a008cc45 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:33.808002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-aa9bd003-afd9-417b-ac65-f0ecc0e74151 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (2aec6d92-a4cd-4845-88ae-1b87a008cc45), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:33.952609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-774be7d5-f395-467b-afaf-b1a28f629f3e tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:33Z,description='',direction='egress',ethertype='IPv6',id=b4dca7b9-69d2-46f9-a227-a415f8378f92,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f0d0c96bbb304882b1f2459361551a93',protocol='ipv6-icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=6fa83794-f114-4d02-9d65-747e3bcbcdb0,updated_at=2022-09-30T09:51:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:33.953077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-774be7d5-f395-467b-afaf-b1a28f629f3e tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b4dca7b9-69d2-46f9-a227-a415f8378f92), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:33.953466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-774be7d5-f395-467b-afaf-b1a28f629f3e tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:51:34.442138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:420 started Sep 30 09:51:34.444976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0532,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=944000000,duration_sec=852,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:34.445556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:34.446937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:420 - starting polling. Elapsed:0.005 Sep 30 09:51:34.449718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:34.453696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:420 - port information retrieved. Elapsed:0.012 Sep 30 09:51:34.454033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', 'c1feeb13-170b-4980-9c93-30ea7a94b340', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': {'2aec6d92-a4cd-4845-88ae-1b87a008cc45'}, 'removed': set(), 'updated': {'2aec6d92-a4cd-4845-88ae-1b87a008cc45'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:34.454620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '2aec6d92-a4cd-4845-88ae-1b87a008cc45', 'device_id': 'ac100cf4-eb69-49ba-85aa-88dc3eb1115d', 'network_id': 'a1a947f8-b8f0-49fd-a3af-298fa4634634', 'port_id': '2aec6d92-a4cd-4845-88ae-1b87a008cc45', 'mac_address': 'fa:16:3e:c9:b1:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '248eeeb2-071e-427b-b827-6d99e6e35d4e', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:51:34.458507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 2aec6d92-a4cd-4845-88ae-1b87a008cc45 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:51:34.458902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 2aec6d92-a4cd-4845-88ae-1b87a008cc45 updated. Details: {'device': '2aec6d92-a4cd-4845-88ae-1b87a008cc45', 'device_id': 'ac100cf4-eb69-49ba-85aa-88dc3eb1115d', 'network_id': 'a1a947f8-b8f0-49fd-a3af-298fa4634634', 'port_id': '2aec6d92-a4cd-4845-88ae-1b87a008cc45', 'mac_address': 'fa:16:3e:c9:b1:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '248eeeb2-071e-427b-b827-6d99e6e35d4e', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 12} Sep 30 09:51:34.459889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-2aec6d92-a4, col_values=(('tag', 12),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:34.460309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-2aec6d92-a4, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:34.460733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-2aec6d92-a4, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:34.467491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-2aec6d92-a4, col_values=(('other_config', {'net_uuid': 'a1a947f8-b8f0-49fd-a3af-298fa4634634', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '12', 'segmentation_id': '350'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:34.474920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0534,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:34.475841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:420 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.021 Sep 30 09:51:34.475841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:51:34.476915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'2aec6d92-a4cd-4845-88ae-1b87a008cc45'} Sep 30 09:51:34.477232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:51:34.477404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:51:34.482424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:34.519344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdc38d0-7d1d-476e-942b-3b854a0b616a]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:34.520083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:420 - agent port security group processed in 0.066 Sep 30 09:51:34.520929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 2aec6d92-a4cd-4845-88ae-1b87a008cc45 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:51:34.781094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['2aec6d92-a4cd-4845-88ae-1b87a008cc45'] and devices down [] completed. Sep 30 09:51:34.781671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:420 - ports processed. Elapsed:0.339 Sep 30 09:51:34.781764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:420 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.340 Sep 30 09:51:35.882917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6bd47e0c-dfe0-4f7b-b14e-c51a9e88bd59 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Resource Port deleted: d3f7eb0a-905a-4efa-b08a-3fca026724aa {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:35.885883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6bd47e0c-dfe0-4f7b-b14e-c51a9e88bd59 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (d3f7eb0a-905a-4efa-b08a-3fca026724aa), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:35.885883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6bd47e0c-dfe0-4f7b-b14e-c51a9e88bd59 tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group member updated {'462c076e-5253-483e-b5c8-ce3514101941'} Sep 30 09:51:36.443495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:421 started Sep 30 09:51:36.445908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0536,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=946000000,duration_sec=854,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:36.446485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:36.446859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:421 - starting polling. Elapsed:0.004 Sep 30 09:51:36.449780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:36.451750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port d3f7eb0a-905a-4efa-b08a-3fca026724aa not present in bridge br-int Sep 30 09:51:36.452078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:51:36.452357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['d3f7eb0a-905a-4efa-b08a-3fca026724aa'] Sep 30 09:51:36.452675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port d3f7eb0a-905a-4efa-b08a-3fca026724aa is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:51:36.456579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:421 - port information retrieved. Elapsed:0.013 Sep 30 09:51:36.456905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:421 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 30 09:51:38.444682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:422 started Sep 30 09:51:38.448834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0538,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=947000000,duration_sec=856,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:38.457466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:38.457466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:422 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:51:40.445583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:423 started Sep 30 09:51:40.448756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c053a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=948000000,duration_sec=858,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:40.453469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:40.453469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:423 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:51:42.446620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:424 started Sep 30 09:51:42.455973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c053c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=949000000,duration_sec=860,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:42.455973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:42.455973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:424 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:51:44.252491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f3f6a9da-7232-4309-9115-6a9344de869b tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Resource Port deleted: 45105b4f-28b5-44d6-bdd3-42f2c0b33de7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:44.253988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f3f6a9da-7232-4309-9115-6a9344de869b tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (45105b4f-28b5-44d6-bdd3-42f2c0b33de7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:44.255030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f3f6a9da-7232-4309-9115-6a9344de869b tempest-ServerRescueNegativeTestJSON-209097963 tempest-ServerRescueNegativeTestJSON-209097963-project] Security group member updated {'462c076e-5253-483e-b5c8-ce3514101941'} Sep 30 09:51:44.381248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-095d9daf-6187-465c-a3f9-8986a7d6311e tempest-VolumesSnapshotTestJSON-1827020212 tempest-VolumesSnapshotTestJSON-1827020212-project] Resource Port deleted: a9cb82d6-80f6-4a57-8692-df8965508945 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:44.381809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-095d9daf-6187-465c-a3f9-8986a7d6311e tempest-VolumesSnapshotTestJSON-1827020212 tempest-VolumesSnapshotTestJSON-1827020212-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (a9cb82d6-80f6-4a57-8692-df8965508945), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:44.382812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-095d9daf-6187-465c-a3f9-8986a7d6311e tempest-VolumesSnapshotTestJSON-1827020212 tempest-VolumesSnapshotTestJSON-1827020212-project] Security group member updated {'5d4b07af-fe86-47c7-ac14-1ea489912242'} Sep 30 09:51:44.447900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:425 started Sep 30 09:51:44.451321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c053e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=951000000,duration_sec=862,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:44.451898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:44.452265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:425 - starting polling. Elapsed:0.005 Sep 30 09:51:44.455201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:44.458243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port a9cb82d6-80f6-4a57-8692-df8965508945 not present in bridge br-int Sep 30 09:51:44.458600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:51:44.460457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 45105b4f-28b5-44d6-bdd3-42f2c0b33de7 not present in bridge br-int Sep 30 09:51:44.462440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:51:44.462440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['45105b4f-28b5-44d6-bdd3-42f2c0b33de7', 'a9cb82d6-80f6-4a57-8692-df8965508945'] Sep 30 09:51:44.462440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 45105b4f-28b5-44d6-bdd3-42f2c0b33de7 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:51:44.462440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port a9cb82d6-80f6-4a57-8692-df8965508945 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:51:44.466036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:425 - port information retrieved. Elapsed:0.018 Sep 30 09:51:44.466377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:425 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.019 Sep 30 09:51:46.448634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:426 started Sep 30 09:51:46.451278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0540,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=951000000,duration_sec=864,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:46.451848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:46.452200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:426 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:51:47.063373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cd7af541-7daf-4432-b6e0-53a272893441 admin admin] Resource Port deleted: c1feeb13-170b-4980-9c93-30ea7a94b340 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:47.063839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cd7af541-7daf-4432-b6e0-53a272893441 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (c1feeb13-170b-4980-9c93-30ea7a94b340), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:48.113811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["f36e1dce-c17b-43ae-9c90-ee5368163ac1","delete","qr-c1feeb13-17",9,["map",[["attached-mac","fa:16:3e:c3:56:a6"],["iface-id","c1feeb13-170b-4980-9c93-30ea7a94b340"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:48.333866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ee63deaf-dacc-45f3-ab56-202c5ad5c1dc tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource Port deleted: 3e38c79a-a565-45f6-a69a-e39595512b01 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:48.334790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ee63deaf-dacc-45f3-ab56-202c5ad5c1dc tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (3e38c79a-a565-45f6-a69a-e39595512b01), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:48.335662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ee63deaf-dacc-45f3-ab56-202c5ad5c1dc tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group member updated {'38da2223-513e-44c4-98ae-77fbb1f57697'} Sep 30 09:51:48.449602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:427 started Sep 30 09:51:48.452232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0542,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=952000000,duration_sec=866,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:48.460269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:48.460269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:427 - starting polling. Elapsed:0.004 Sep 30 09:51:48.460269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:48.460269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 3e38c79a-a565-45f6-a69a-e39595512b01 not present in bridge br-int Sep 30 09:51:48.460269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:51:48.460269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['3e38c79a-a565-45f6-a69a-e39595512b01'] Sep 30 09:51:48.460789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 3e38c79a-a565-45f6-a69a-e39595512b01 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:51:48.465254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0544,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 9}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:48.465696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:427 - port information retrieved. Elapsed:0.016 Sep 30 09:51:48.466035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', '233f84ff-dc41-412a-921b-4b701aa6e0c9', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '94897731-51b0-456e-b633-f954a65edcca', '2d9bcc54-7b5a-4444-8ddc-d386c01296fb', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'c1feeb13-170b-4980-9c93-30ea7a94b340'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:48.466356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:427 - agent port security group processed in 0.000 Sep 30 09:51:48.468987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:51:48.469284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'c1feeb13-170b-4980-9c93-30ea7a94b340'} Sep 30 09:51:48.469721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:48.512514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0c169d1e-33c1-49e5-8ac7-a0f98c950469 admin admin] Resource Port deleted: 233f84ff-dc41-412a-921b-4b701aa6e0c9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:48.516443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0c169d1e-33c1-49e5-8ac7-a0f98c950469 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (233f84ff-dc41-412a-921b-4b701aa6e0c9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:48.531047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d9e64a-5623-4c3f-8c80-e9ea29ebb8ab]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:48.531806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'c1feeb13-170b-4980-9c93-30ea7a94b340'} removed Sep 30 09:51:48.542501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3626d79b-ba62-4e2a-8494-0c2e1f6ad802","delete","qg-233f84ff-dc",10,["map",[["attached-mac","fa:16:3e:84:bb:3b"],["iface-id","233f84ff-dc41-412a-921b-4b701aa6e0c9"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:48.569255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:51:48.570137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:427 - treat_devices_removed completed in 0.100 Sep 30 09:51:48.570137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:427 - ports processed. Elapsed:0.121 Sep 30 09:51:48.570364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:427 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.121 Sep 30 09:51:49.237700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-98e82ad0-d5b2-488c-be7f-c6b6348f849e admin admin] Resource Subnet deleted: 5097a34b-c136-47dd-9d48-0761ca5f7a16 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:49.238293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-98e82ad0-d5b2-488c-be7f-c6b6348f849e admin admin] Publish callbacks [] for Subnet (5097a34b-c136-47dd-9d48-0761ca5f7a16), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:49.477997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["1c873a73-54de-47d2-93c3-af87a8793033","delete","tap2d9bcc54-7b",6,["map",[["attached-mac","fa:16:3e:1b:a6:e8"],["iface-id","2d9bcc54-7b5a-4444-8ddc-d386c01296fb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:49.668092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e75ff100-f3a8-4058-9737-2e7fc8d54484 admin admin] Resource Port deleted: 2d9bcc54-7b5a-4444-8ddc-d386c01296fb {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:49.669257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e75ff100-f3a8-4058-9737-2e7fc8d54484 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (2d9bcc54-7b5a-4444-8ddc-d386c01296fb), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:49.762780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-55285329-5d52-42d1-8684-1555e0226815 None None] Resource Port deleted: 2d9bcc54-7b5a-4444-8ddc-d386c01296fb {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:49.763114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-55285329-5d52-42d1-8684-1555e0226815 None None] Skipped duplicate delete event for 2d9bcc54-7b5a-4444-8ddc-d386c01296fb {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 30 09:51:50.014168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e75ff100-f3a8-4058-9737-2e7fc8d54484 admin admin] Resource Network deleted: 069f8527-f158-4f06-809a-7a507bf3fc84 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:50.019013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e75ff100-f3a8-4058-9737-2e7fc8d54484 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (069f8527-f158-4f06-809a-7a507bf3fc84), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:50.450528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:428 started Sep 30 09:51:50.457017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0546,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=953000000,duration_sec=868,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:50.457713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:50.458185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:428 - starting polling. Elapsed:0.008 Sep 30 09:51:50.460826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:50.466290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0548,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 10}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:50.468121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c054a,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 6}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:50.468443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:428 - port information retrieved. Elapsed:0.018 Sep 30 09:51:50.468957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '94897731-51b0-456e-b633-f954a65edcca', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '233f84ff-dc41-412a-921b-4b701aa6e0c9'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:50.469285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:428 - agent port security group processed in 0.000 Sep 30 09:51:50.471768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:51:50.472148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '233f84ff-dc41-412a-921b-4b701aa6e0c9'} Sep 30 09:51:50.476224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 8 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:50.510852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[426c8024-e112-4a32-bbbe-a4c1179a0989]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:50.511453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'2d9bcc54-7b5a-4444-8ddc-d386c01296fb', '233f84ff-dc41-412a-921b-4b701aa6e0c9'} removed Sep 30 09:51:50.562865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:51:50.563296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Reclaiming vlan = 4 from net-id = 069f8527-f158-4f06-809a-7a507bf3fc84, seg-id = 391 Sep 30 09:51:50.566724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xc9105f02,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16864421859504038737,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4100}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:50.582348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xf1c054c,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4487}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:50.582797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:428 - treat_devices_removed completed in 0.111 Sep 30 09:51:50.583092 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:428 - ports processed. Elapsed:0.133 Sep 30 09:51:50.583420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:428 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.133 Sep 30 09:51:50.790974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Resource SecurityGroup deleted: 462c076e-5253-483e-b5c8-ce3514101941 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:50.791232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (462c076e-5253-483e-b5c8-ce3514101941), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:50.791904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('462c076e-5253-483e-b5c8-ce3514101941',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:51:50.806578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('462c076e-5253-483e-b5c8-ce3514101941',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:51:50.808194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Resource SecurityGroupRule deleted: 2835e232-08eb-49c2-8214-af22f0898bac {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:50.808574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2835e232-08eb-49c2-8214-af22f0898bac), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:50.809581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Security group rule updated ['462c076e-5253-483e-b5c8-ce3514101941'] Sep 30 09:51:50.809989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Resource SecurityGroupRule deleted: 598dbe34-e500-4c22-a5b1-cf5c35317b40 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:50.810340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (598dbe34-e500-4c22-a5b1-cf5c35317b40), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:50.810796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Security group rule updated ['462c076e-5253-483e-b5c8-ce3514101941'] Sep 30 09:51:50.811817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Resource SecurityGroupRule deleted: b67d73f4-bd19-4397-9c89-148550219d86 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:50.812431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b67d73f4-bd19-4397-9c89-148550219d86), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:50.813442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Security group rule updated ['462c076e-5253-483e-b5c8-ce3514101941'] Sep 30 09:51:50.813822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Resource SecurityGroupRule deleted: c8ffaaca-5d6f-4b0c-9c35-0d8bfc15004c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:50.814304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c8ffaaca-5d6f-4b0c-9c35-0d8bfc15004c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:50.814651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-40a1d735-f346-463b-930e-622aa3d52659 admin admin] Security group rule updated ['462c076e-5253-483e-b5c8-ce3514101941'] Sep 30 09:51:52.063301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroup deleted: 38da2223-513e-44c4-98ae-77fbb1f57697 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:52.063883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (38da2223-513e-44c4-98ae-77fbb1f57697), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:52.064165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('38da2223-513e-44c4-98ae-77fbb1f57697',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:51:52.078556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('38da2223-513e-44c4-98ae-77fbb1f57697',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:51:52.079103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: 9027b7db-8c05-43c1-ab83-29fcff4f337a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:52.079640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (9027b7db-8c05-43c1-ab83-29fcff4f337a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:52.080147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['38da2223-513e-44c4-98ae-77fbb1f57697'] Sep 30 09:51:52.080718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: acdf1ca6-a68a-47c1-b37c-f56242ef0077 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:52.081066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (acdf1ca6-a68a-47c1-b37c-f56242ef0077), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:52.081618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['38da2223-513e-44c4-98ae-77fbb1f57697'] Sep 30 09:51:52.081986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: 81131084-a508-4412-8c80-d330688294be {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:52.082311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (81131084-a508-4412-8c80-d330688294be), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:52.082801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['38da2223-513e-44c4-98ae-77fbb1f57697'] Sep 30 09:51:52.083402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: 22a6f274-c9a2-45a3-9775-57d53911c53c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:52.086017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (22a6f274-c9a2-45a3-9775-57d53911c53c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:52.086017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ef320ce0-d149-46e7-a04d-9e0010c24ba1 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['38da2223-513e-44c4-98ae-77fbb1f57697'] Sep 30 09:51:52.238066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:51:52Z,description='Default security group',id=fb29bb3c-19ab-4439-8e3f-58ed6b5990aa,is_default=True,name='default',project_id='1142014cc9284cf1833e5bfbcdb41599',revision_number=1,rules=[SecurityGroupRule(27cc4b53-7cfe-4dc3-a46a-c3a3d32c7fa4),SecurityGroupRule(340ce3ba-7e28-451a-80a0-4b2246cc1e48),SecurityGroupRule(4c971e56-60bd-43b5-823f-f6be64dfc372),SecurityGroupRule(d2f16c4c-481d-4963-b725-f92ef97a3072)],shared=False,stateful=True,updated_at=2022-09-30T09:51:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:52.238736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (fb29bb3c-19ab-4439-8e3f-58ed6b5990aa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:52.239470 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:52Z,description=,direction='ingress',ethertype='IPv6',id=27cc4b53-7cfe-4dc3-a46a-c3a3d32c7fa4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1142014cc9284cf1833e5bfbcdb41599',protocol=,remote_address_group_id=,remote_group_id=fb29bb3c-19ab-4439-8e3f-58ed6b5990aa,remote_ip_prefix=,revision_number=0,security_group_id=fb29bb3c-19ab-4439-8e3f-58ed6b5990aa,updated_at=2022-09-30T09:51:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:52.240140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (27cc4b53-7cfe-4dc3-a46a-c3a3d32c7fa4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:52.240489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Security group rule updated ['fb29bb3c-19ab-4439-8e3f-58ed6b5990aa'] Sep 30 09:51:52.241177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:52Z,description=,direction='egress',ethertype='IPv6',id=340ce3ba-7e28-451a-80a0-4b2246cc1e48,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1142014cc9284cf1833e5bfbcdb41599',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fb29bb3c-19ab-4439-8e3f-58ed6b5990aa,updated_at=2022-09-30T09:51:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:52.241536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (340ce3ba-7e28-451a-80a0-4b2246cc1e48), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:52.241869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Security group rule updated ['fb29bb3c-19ab-4439-8e3f-58ed6b5990aa'] Sep 30 09:51:52.242566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:52Z,description=,direction='egress',ethertype='IPv4',id=4c971e56-60bd-43b5-823f-f6be64dfc372,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1142014cc9284cf1833e5bfbcdb41599',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fb29bb3c-19ab-4439-8e3f-58ed6b5990aa,updated_at=2022-09-30T09:51:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:52.243259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4c971e56-60bd-43b5-823f-f6be64dfc372), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:52.243779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Security group rule updated ['fb29bb3c-19ab-4439-8e3f-58ed6b5990aa'] Sep 30 09:51:52.244464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:52Z,description=,direction='ingress',ethertype='IPv4',id=d2f16c4c-481d-4963-b725-f92ef97a3072,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1142014cc9284cf1833e5bfbcdb41599',protocol=,remote_address_group_id=,remote_group_id=fb29bb3c-19ab-4439-8e3f-58ed6b5990aa,remote_ip_prefix=,revision_number=0,security_group_id=fb29bb3c-19ab-4439-8e3f-58ed6b5990aa,updated_at=2022-09-30T09:51:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:52.244882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d2f16c4c-481d-4963-b725-f92ef97a3072), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:52.245891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Security group rule updated ['fb29bb3c-19ab-4439-8e3f-58ed6b5990aa'] Sep 30 09:51:52.433984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:51:52Z,description='',dns_domain=None,id=6555801d-cf6b-484f-a48c-039d4395e1ca,mtu=1500,name='tempest-AttachVolumeShelveTestJSON-1575734806-network',project_id='1142014cc9284cf1833e5bfbcdb41599',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(6555801d-cf6b-484f-a48c-039d4395e1ca),segments=[NetworkSegment(02e0c40d-c6ca-4ad2-9b3f-4b04b702f1ed)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:51:52Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:52.434363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (6555801d-cf6b-484f-a48c-039d4395e1ca), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:52.451460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:429 started Sep 30 09:51:52.454168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c054e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=954000000,duration_sec=870,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:52.454779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:52.455133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:429 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:51:52.509377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-cd1860b8-c395-4ec1-baa4-96612e900952 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 6555801d-cf6b-484f-a48c-039d4395e1ca with segmentation id not found. Sep 30 09:51:52.509377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:51:52.509377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:51:52.509377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:51:52.509377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:51:52.509377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:51:52.509377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:51:52.509377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:51:52.509377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:51:52.509377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:51:52.509377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:51:52.509377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:51:52.509377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:51:52.510563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:51:52.510563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:51:52.510563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:51:52.510563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 6555801d-cf6b-484f-a48c-039d4395e1ca with segmentation id not found. Sep 30 09:51:52.510563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:51:52.513339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-fb844945-4074-499a-8f25-1ac72f389ec8 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource Port deleted: 6671e850-25ca-4183-8340-e801d0d5775c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:51:52.513889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-fb844945-4074-499a-8f25-1ac72f389ec8 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (6671e850-25ca-4183-8340-e801d0d5775c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:52.842863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1ae6c1d8-73d3-4859-90ea-4c0493bea3f7 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(a0586683-b244-45ac-a33c-b768ced9f22a)],cidr=172.20.0.0/28,created_at=2022-09-30T09:51:52Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=33641e3b-dbf8-48b8-92c8-d70b8e4cb83e,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeShelveTestJSON-1575734806-subnet',network_id=6555801d-cf6b-484f-a48c-039d4395e1ca,project_id='1142014cc9284cf1833e5bfbcdb41599',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:51:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:52.843236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1ae6c1d8-73d3-4859-90ea-4c0493bea3f7 admin admin] Publish callbacks [] for Subnet (33641e3b-dbf8-48b8-92c8-d70b8e4cb83e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:53.008768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4cc6d98c-9747-4129-bd88-795f71121236 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:51:52Z,description='tempest-description--807484928',id=91ed8715-2dc6-4013-a8e5-1d4a5ad44d27,is_default=False,name='tempest-securitygroup--1266574320',project_id='86e6b0501cb94028be07bddd2182638b',revision_number=1,rules=[SecurityGroupRule(3c5e1c22-bfdc-4900-ad7a-1a84f4e023d6),SecurityGroupRule(44cbeae4-fed1-45e4-98e1-dbc6c4711f3a)],shared=False,stateful=True,updated_at=2022-09-30T09:51:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:53.009220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4cc6d98c-9747-4129-bd88-795f71121236 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (91ed8715-2dc6-4013-a8e5-1d4a5ad44d27), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:53.009931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4cc6d98c-9747-4129-bd88-795f71121236 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:52Z,description=,direction='egress',ethertype='IPv6',id=3c5e1c22-bfdc-4900-ad7a-1a84f4e023d6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=91ed8715-2dc6-4013-a8e5-1d4a5ad44d27,updated_at=2022-09-30T09:51:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:53.010365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4cc6d98c-9747-4129-bd88-795f71121236 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (3c5e1c22-bfdc-4900-ad7a-1a84f4e023d6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:53.010843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4cc6d98c-9747-4129-bd88-795f71121236 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['91ed8715-2dc6-4013-a8e5-1d4a5ad44d27'] Sep 30 09:51:53.011582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4cc6d98c-9747-4129-bd88-795f71121236 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:52Z,description=,direction='egress',ethertype='IPv4',id=44cbeae4-fed1-45e4-98e1-dbc6c4711f3a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=91ed8715-2dc6-4013-a8e5-1d4a5ad44d27,updated_at=2022-09-30T09:51:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:53.012002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4cc6d98c-9747-4129-bd88-795f71121236 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (44cbeae4-fed1-45e4-98e1-dbc6c4711f3a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:53.012398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4cc6d98c-9747-4129-bd88-795f71121236 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['91ed8715-2dc6-4013-a8e5-1d4a5ad44d27'] Sep 30 09:51:53.462787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-90d54a99-0eaf-4803-a78a-ca839f3db15b tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:53Z,description='',direction='ingress',ethertype='IPv4',id=8a83e4ec-9947-4351-83aa-014898ac5a8b,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='86e6b0501cb94028be07bddd2182638b',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=91ed8715-2dc6-4013-a8e5-1d4a5ad44d27,updated_at=2022-09-30T09:51:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:53.463278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-90d54a99-0eaf-4803-a78a-ca839f3db15b tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8a83e4ec-9947-4351-83aa-014898ac5a8b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:53.463412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-90d54a99-0eaf-4803-a78a-ca839f3db15b tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['91ed8715-2dc6-4013-a8e5-1d4a5ad44d27'] Sep 30 09:51:53.659093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dbc4e493-9fae-456a-9907-911e57c4c8b8 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:51:53Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6555801d-cf6b-484f-a48c-039d4395e1ca',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=b7a27b78-a40e-4f25-8170-bf802b8d0bf6,mac_address=fa:16:3e:83:29:51,name='',network_id=6555801d-cf6b-484f-a48c-039d4395e1ca,numa_affinity_policy=,project_id='1142014cc9284cf1833e5bfbcdb41599',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(b7a27b78-a40e-4f25-8170-bf802b8d0bf6),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:51:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:53.659668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dbc4e493-9fae-456a-9907-911e57c4c8b8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (b7a27b78-a40e-4f25-8170-bf802b8d0bf6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:53.900358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8a2b1cbd-44b6-41c5-a7b5-14e70db995c7 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:53Z,description='',direction='ingress',ethertype='IPv4',id=96c9aea8-bdcc-4f77-81c7-ff3dd52013c1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='86e6b0501cb94028be07bddd2182638b',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=91ed8715-2dc6-4013-a8e5-1d4a5ad44d27,updated_at=2022-09-30T09:51:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:53.900688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8a2b1cbd-44b6-41c5-a7b5-14e70db995c7 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (96c9aea8-bdcc-4f77-81c7-ff3dd52013c1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:53.901032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8a2b1cbd-44b6-41c5-a7b5-14e70db995c7 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['91ed8715-2dc6-4013-a8e5-1d4a5ad44d27'] Sep 30 09:51:54.013761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dbc4e493-9fae-456a-9907-911e57c4c8b8 None None] Resource Port b7a27b78-a40e-4f25-8170-bf802b8d0bf6 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=b7a27b78-a40e-4f25-8170-bf802b8d0bf6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=b7a27b78-a40e-4f25-8170-bf802b8d0bf6,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=b7a27b78-a40e-4f25-8170-bf802b8d0bf6,segment=NetworkSegment(02e0c40d-c6ca-4ad2-9b3f-4b04b702f1ed),segment_id=02e0c40d-c6ca-4ad2-9b3f-4b04b702f1ed)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:54.014178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dbc4e493-9fae-456a-9907-911e57c4c8b8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (b7a27b78-a40e-4f25-8170-bf802b8d0bf6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:54.139119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ffbb9e47-b2b1-44b4-9acc-6a6f3b7de0b2","insert","tapb7a27b78-a4",["set",[]],["map",[["attached-mac","fa:16:3e:83:29:51"],["iface-id","b7a27b78-a40e-4f25-8170-bf802b8d0bf6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:54.140320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ffbb9e47-b2b1-44b4-9acc-6a6f3b7de0b2","old",null,["set",[]],null],["","new","tapb7a27b78-a4",33,["map",[["attached-mac","fa:16:3e:83:29:51"],["iface-id","b7a27b78-a40e-4f25-8170-bf802b8d0bf6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:54.452461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:430 started Sep 30 09:51:54.455396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0550,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=955000000,duration_sec=872,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:54.456322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:54.456904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:430 - starting polling. Elapsed:0.005 Sep 30 09:51:54.460829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:54.463608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 6671e850-25ca-4183-8340-e801d0d5775c not present in bridge br-int Sep 30 09:51:54.473984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:51:54.475281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['6671e850-25ca-4183-8340-e801d0d5775c'] Sep 30 09:51:54.475762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 6671e850-25ca-4183-8340-e801d0d5775c is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:51:54.483558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:430 - port information retrieved. Elapsed:0.031 Sep 30 09:51:54.484579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '94897731-51b0-456e-b633-f954a65edcca', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': {'b7a27b78-a40e-4f25-8170-bf802b8d0bf6'}, 'removed': set(), 'updated': {'b7a27b78-a40e-4f25-8170-bf802b8d0bf6'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:54.485861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6555801d-cf6b-484f-a48c-039d4395e1ca', 'network_id': '6555801d-cf6b-484f-a48c-039d4395e1ca', 'port_id': 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', 'mac_address': 'fa:16:3e:83:29:51', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '33641e3b-dbf8-48b8-92c8-d70b8e4cb83e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:51:54.490403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: b7a27b78-a40e-4f25-8170-bf802b8d0bf6 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:51:54.491221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port b7a27b78-a40e-4f25-8170-bf802b8d0bf6 updated. Details: {'device': 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6555801d-cf6b-484f-a48c-039d4395e1ca', 'network_id': '6555801d-cf6b-484f-a48c-039d4395e1ca', 'port_id': 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', 'mac_address': 'fa:16:3e:83:29:51', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '33641e3b-dbf8-48b8-92c8-d70b8e4cb83e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:51:54.491749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 13 as local vlan for net-id=6555801d-cf6b-484f-a48c-039d4395e1ca, seg-id=391 Sep 30 09:51:54.497601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8db4ed19-59bc-426b-8992-9bc4475b039a admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:51:53Z,data_plane_status=None,description='',device_id='2638e8e4-8e6c-4d9d-821c-9e13d40cad6e',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=419b6762-0832-495f-98ee-a4ec35979ac6,mac_address=fa:16:3e:89:a2:e6,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(419b6762-0832-495f-98ee-a4ec35979ac6),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:51:54Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:54.498170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8db4ed19-59bc-426b-8992-9bc4475b039a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (419b6762-0832-495f-98ee-a4ec35979ac6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:54.505319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xc9105f04,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4487), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:54.510002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xf1c0552,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4109)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4487}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:54.511487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapb7a27b78-a4, col_values=(('tag', 13),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:54.512005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapb7a27b78-a4, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:54.512438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapb7a27b78-a4, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:54.518106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapb7a27b78-a4, col_values=(('other_config', {'net_uuid': '6555801d-cf6b-484f-a48c-039d4395e1ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '391'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:54.536089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0554,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:54.537010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:430 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.051 Sep 30 09:51:54.537528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:51:54.537827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'b7a27b78-a40e-4f25-8170-bf802b8d0bf6'} Sep 30 09:51:54.539067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:51:54.539351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:51:54.545405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:54.596125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[0218855b-b64f-4408-9dc0-519f7cded8e5]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:54.596740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:430 - agent port security group processed in 0.112 Sep 30 09:51:54.597549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for b7a27b78-a40e-4f25-8170-bf802b8d0bf6 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:51:54.959178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b3b24dc7-3fd9-4fc0-ba55-0a5ab9cdbaa6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:51:54Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=29037efc-20a5-4ae7-aabd-5ff75de505f6,mac_address=fa:16:3e:33:b7:bb,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(29037efc-20a5-4ae7-aabd-5ff75de505f6),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T09:51:54Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:54.959951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b3b24dc7-3fd9-4fc0-ba55-0a5ab9cdbaa6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (29037efc-20a5-4ae7-aabd-5ff75de505f6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:55.025923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['b7a27b78-a40e-4f25-8170-bf802b8d0bf6'] and devices down [] completed. Sep 30 09:51:55.026954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:430 - ports processed. Elapsed:0.574 Sep 30 09:51:55.028744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:430 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.575 Sep 30 09:51:55.106539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port b7a27b78-a40e-4f25-8170-bf802b8d0bf6 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:55.107393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (b7a27b78-a40e-4f25-8170-bf802b8d0bf6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:55.955352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b3b24dc7-3fd9-4fc0-ba55-0a5ab9cdbaa6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource Port 29037efc-20a5-4ae7-aabd-5ff75de505f6 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '5db41540-44d2-4c53-b3d6-92f787a17150'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:55.955917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b3b24dc7-3fd9-4fc0-ba55-0a5ab9cdbaa6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (29037efc-20a5-4ae7-aabd-5ff75de505f6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:56.455166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:431 started Sep 30 09:51:56.457769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0556,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=958000000,duration_sec=874,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:56.458419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:56.459284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:431 - starting polling. Elapsed:0.004 Sep 30 09:51:56.462701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:56.467139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:431 - port information retrieved. Elapsed:0.012 Sep 30 09:51:56.467578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '94897731-51b0-456e-b633-f954a65edcca', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': set(), 'updated': {'b7a27b78-a40e-4f25-8170-bf802b8d0bf6'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:56.468185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6555801d-cf6b-484f-a48c-039d4395e1ca', 'network_id': '6555801d-cf6b-484f-a48c-039d4395e1ca', 'port_id': 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', 'mac_address': 'fa:16:3e:83:29:51', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '33641e3b-dbf8-48b8-92c8-d70b8e4cb83e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:51:56.472053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: b7a27b78-a40e-4f25-8170-bf802b8d0bf6 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:51:56.472580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port b7a27b78-a40e-4f25-8170-bf802b8d0bf6 updated. Details: {'device': 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6555801d-cf6b-484f-a48c-039d4395e1ca', 'network_id': '6555801d-cf6b-484f-a48c-039d4395e1ca', 'port_id': 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', 'mac_address': 'fa:16:3e:83:29:51', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '33641e3b-dbf8-48b8-92c8-d70b8e4cb83e', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Sep 30 09:51:56.473947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapb7a27b78-a4, col_values=(('tag', 13),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:56.474535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tapb7a27b78-a4, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:56.475115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tapb7a27b78-a4, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:56.475563 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:51:56.477106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tapb7a27b78-a4, col_values=(('other_config', {'net_uuid': '6555801d-cf6b-484f-a48c-039d4395e1ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': '391', 'tag': '13'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:56.477824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:51:56.480087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0558,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:56.485461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:431 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 20 devices currently available. Time elapsed: 0.013 Sep 30 09:51:56.485461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:51:56.485461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:51:56.485461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:51:56.485461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:51:56.486867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:56.529170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c405ee-bb73-46c4-89f7-f2185b0ef2df]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:56.530050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:431 - agent port security group processed in 0.062 Sep 30 09:51:56.531642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for b7a27b78-a40e-4f25-8170-bf802b8d0bf6 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:51:56.833098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['b7a27b78-a40e-4f25-8170-bf802b8d0bf6'] and devices down [] completed. Sep 30 09:51:56.833423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:431 - ports processed. Elapsed:0.378 Sep 30 09:51:56.833869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:431 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.379 Sep 30 09:51:56.960001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-db8543e9-c0b2-4855-86a8-6848e2626c4a None None] Resource Port 419b6762-0832-495f-98ee-a4ec35979ac6 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=419b6762-0832-495f-98ee-a4ec35979ac6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=419b6762-0832-495f-98ee-a4ec35979ac6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:56.963521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-db8543e9-c0b2-4855-86a8-6848e2626c4a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (419b6762-0832-495f-98ee-a4ec35979ac6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:57.185310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-db8543e9-c0b2-4855-86a8-6848e2626c4a None None] Resource Port 419b6762-0832-495f-98ee-a4ec35979ac6 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=419b6762-0832-495f-98ee-a4ec35979ac6,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=419b6762-0832-495f-98ee-a4ec35979ac6,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=419b6762-0832-495f-98ee-a4ec35979ac6,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:57.185696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-db8543e9-c0b2-4855-86a8-6848e2626c4a None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (419b6762-0832-495f-98ee-a4ec35979ac6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:57.425711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-81176b9f-f596-42b5-8f4a-005131a7661d admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:51:56Z,data_plane_status=None,description='',device_id='2638e8e4-8e6c-4d9d-821c-9e13d40cad6e',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=6b2eeaac-b65e-4315-9e6b-2f3f7f643e90,mac_address=fa:16:3e:38:23:ec,name='',network_id=6555801d-cf6b-484f-a48c-039d4395e1ca,numa_affinity_policy=,project_id='1142014cc9284cf1833e5bfbcdb41599',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(6b2eeaac-b65e-4315-9e6b-2f3f7f643e90),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:51:57Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:57.426737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-81176b9f-f596-42b5-8f4a-005131a7661d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6b2eeaac-b65e-4315-9e6b-2f3f7f643e90), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:57.748224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["47300bb6-ad2e-49be-ba47-5e21fb9643d0","insert","qg-419b6762-08",["set",[]],["map",[["attached-mac","fa:16:3e:89:a2:e6"],["iface-id","419b6762-0832-495f-98ee-a4ec35979ac6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:57.764177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["47300bb6-ad2e-49be-ba47-5e21fb9643d0","old",null,["set",[]],null],["","new","qg-419b6762-08",34,["map",[["attached-mac","fa:16:3e:89:a2:e6"],["iface-id","419b6762-0832-495f-98ee-a4ec35979ac6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:51:58.170629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-81176b9f-f596-42b5-8f4a-005131a7661d admin admin] Received resource Port update without any changes: 6b2eeaac-b65e-4315-9e6b-2f3f7f643e90 {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 30 09:51:58.456046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:432 started Sep 30 09:51:58.459720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c055a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=958000000,duration_sec=876,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:58.460311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:51:58.460768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:432 - starting polling. Elapsed:0.005 Sep 30 09:51:58.463915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:58.474738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:432 - port information retrieved. Elapsed:0.014 Sep 30 09:51:58.475288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '94897731-51b0-456e-b633-f954a65edcca', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '419b6762-0832-495f-98ee-a4ec35979ac6', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': {'419b6762-0832-495f-98ee-a4ec35979ac6'}, 'removed': set(), 'updated': {'419b6762-0832-495f-98ee-a4ec35979ac6'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:51:58.478850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '419b6762-0832-495f-98ee-a4ec35979ac6', 'device_id': '2638e8e4-8e6c-4d9d-821c-9e13d40cad6e', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '419b6762-0832-495f-98ee-a4ec35979ac6', 'mac_address': 'fa:16:3e:89:a2:e6', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.188'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:51:58.480384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 419b6762-0832-495f-98ee-a4ec35979ac6 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:51:58.480714 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 419b6762-0832-495f-98ee-a4ec35979ac6 updated. Details: {'device': '419b6762-0832-495f-98ee-a4ec35979ac6', 'device_id': '2638e8e4-8e6c-4d9d-821c-9e13d40cad6e', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '419b6762-0832-495f-98ee-a4ec35979ac6', 'mac_address': 'fa:16:3e:89:a2:e6', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.188'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:51:58.481873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-419b6762-08, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:58.491023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-419b6762-08, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:58.491627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-419b6762-08, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:58.500858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-419b6762-08, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:51:58.522640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c055c,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:51:58.522640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:432 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 21 devices currently available. Time elapsed: 0.043 Sep 30 09:51:58.522640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:51:58.522640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'419b6762-0832-495f-98ee-a4ec35979ac6'} Sep 30 09:51:58.522640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:51:58.523261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:51:58.525498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:51:58.581404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc6d645-4d3a-4b4d-9994-58002d1e09a5]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:51:58.582109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:432 - agent port security group processed in 0.106 Sep 30 09:51:58.583117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 419b6762-0832-495f-98ee-a4ec35979ac6 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:51:58.871338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['419b6762-0832-495f-98ee-a4ec35979ac6'] and devices down [] completed. Sep 30 09:51:58.876802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:432 - ports processed. Elapsed:0.416 Sep 30 09:51:58.877157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:432 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.421 Sep 30 09:51:58.964849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port 419b6762-0832-495f-98ee-a4ec35979ac6 updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=419b6762-0832-495f-98ee-a4ec35979ac6,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=419b6762-0832-495f-98ee-a4ec35979ac6,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:51:58.965233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (419b6762-0832-495f-98ee-a4ec35979ac6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:59.500558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f50dab25-4e68-4ea1-9e54-34c602958e93 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:51:59Z,description='tempest-description--224074788',id=951ad8ca-ad5f-4420-bbe5-c5c64ad050b4,is_default=False,name='tempest-securitygroup--32578007',project_id='1142014cc9284cf1833e5bfbcdb41599',revision_number=1,rules=[SecurityGroupRule(e210e033-f60b-4060-b2d9-017b77f6ceed),SecurityGroupRule(fbeb1252-2357-45cd-84d5-f91af4fdc28d)],shared=False,stateful=True,updated_at=2022-09-30T09:51:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:59.501201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f50dab25-4e68-4ea1-9e54-34c602958e93 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (951ad8ca-ad5f-4420-bbe5-c5c64ad050b4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:59.501539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f50dab25-4e68-4ea1-9e54-34c602958e93 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:59Z,description=,direction='egress',ethertype='IPv6',id=e210e033-f60b-4060-b2d9-017b77f6ceed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1142014cc9284cf1833e5bfbcdb41599',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=951ad8ca-ad5f-4420-bbe5-c5c64ad050b4,updated_at=2022-09-30T09:51:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:59.502138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f50dab25-4e68-4ea1-9e54-34c602958e93 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e210e033-f60b-4060-b2d9-017b77f6ceed), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:59.502660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f50dab25-4e68-4ea1-9e54-34c602958e93 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['951ad8ca-ad5f-4420-bbe5-c5c64ad050b4'] Sep 30 09:51:59.503695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f50dab25-4e68-4ea1-9e54-34c602958e93 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:59Z,description=,direction='egress',ethertype='IPv4',id=fbeb1252-2357-45cd-84d5-f91af4fdc28d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1142014cc9284cf1833e5bfbcdb41599',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=951ad8ca-ad5f-4420-bbe5-c5c64ad050b4,updated_at=2022-09-30T09:51:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:51:59.504259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f50dab25-4e68-4ea1-9e54-34c602958e93 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (fbeb1252-2357-45cd-84d5-f91af4fdc28d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:51:59.504758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f50dab25-4e68-4ea1-9e54-34c602958e93 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['951ad8ca-ad5f-4420-bbe5-c5c64ad050b4'] Sep 30 09:52:00.188415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0f2ab5d8-22d3-4c84-88dc-b7611d7b94ff tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:51:59Z,description='',direction='ingress',ethertype='IPv4',id=6f0f3466-b03c-4510-a77d-c82e759088c2,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='1142014cc9284cf1833e5bfbcdb41599',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=951ad8ca-ad5f-4420-bbe5-c5c64ad050b4,updated_at=2022-09-30T09:51:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:52:00.188988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0f2ab5d8-22d3-4c84-88dc-b7611d7b94ff tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (6f0f3466-b03c-4510-a77d-c82e759088c2), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:00.189332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0f2ab5d8-22d3-4c84-88dc-b7611d7b94ff tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['951ad8ca-ad5f-4420-bbe5-c5c64ad050b4'] Sep 30 09:52:00.273621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-49ca3a9f-60ca-436d-a8f0-7505b5721c72 None None] Resource Port 6b2eeaac-b65e-4315-9e6b-2f3f7f643e90 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=6b2eeaac-b65e-4315-9e6b-2f3f7f643e90,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6b2eeaac-b65e-4315-9e6b-2f3f7f643e90,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:00.274865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-49ca3a9f-60ca-436d-a8f0-7505b5721c72 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6b2eeaac-b65e-4315-9e6b-2f3f7f643e90), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:00.456815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:433 started Sep 30 09:52:00.460200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c055e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=959000000,duration_sec=878,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:00.460914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:00.461349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:433 - starting polling. Elapsed:0.005 Sep 30 09:52:00.464923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:00.471458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:433 - port information retrieved. Elapsed:0.015 Sep 30 09:52:00.480226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '94897731-51b0-456e-b633-f954a65edcca', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '419b6762-0832-495f-98ee-a4ec35979ac6', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': set(), 'updated': {'419b6762-0832-495f-98ee-a4ec35979ac6'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:52:00.480417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '419b6762-0832-495f-98ee-a4ec35979ac6', 'device_id': '2638e8e4-8e6c-4d9d-821c-9e13d40cad6e', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '419b6762-0832-495f-98ee-a4ec35979ac6', 'mac_address': 'fa:16:3e:89:a2:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.188'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:52:00.480831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 419b6762-0832-495f-98ee-a4ec35979ac6 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:52:00.481812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 419b6762-0832-495f-98ee-a4ec35979ac6 updated. Details: {'device': '419b6762-0832-495f-98ee-a4ec35979ac6', 'device_id': '2638e8e4-8e6c-4d9d-821c-9e13d40cad6e', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': '419b6762-0832-495f-98ee-a4ec35979ac6', 'mac_address': 'fa:16:3e:89:a2:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.188'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:52:00.483337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-419b6762-08, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:52:00.483945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-419b6762-08, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:52:00.485006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-419b6762-08, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:52:00.485622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:52:00.486559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-419b6762-08, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:52:00.487813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:52:00.492071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0560,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:00.493025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:433 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 21 devices currently available. Time elapsed: 0.017 Sep 30 09:52:00.493677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 1 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:52:00.494121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:52:00.496001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:52:00.496455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:52:00.501784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:52:00.553216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11a2379-cd64-4a54-a3ab-8a1010616fa0]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:52:00.554287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:433 - agent port security group processed in 0.079 Sep 30 09:52:00.556023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 419b6762-0832-495f-98ee-a4ec35979ac6 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:52:00.743582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5a78afee-335c-4126-a08d-324b38733d2a tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:52:00Z,description='',direction='ingress',ethertype='IPv4',id=8f64812b-cb30-4fb9-83a9-f8ebfe1a7c54,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1142014cc9284cf1833e5bfbcdb41599',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=951ad8ca-ad5f-4420-bbe5-c5c64ad050b4,updated_at=2022-09-30T09:52:00Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:52:00.743969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5a78afee-335c-4126-a08d-324b38733d2a tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8f64812b-cb30-4fb9-83a9-f8ebfe1a7c54), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:00.744312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5a78afee-335c-4126-a08d-324b38733d2a tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['951ad8ca-ad5f-4420-bbe5-c5c64ad050b4'] Sep 30 09:52:00.873244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-49ca3a9f-60ca-436d-a8f0-7505b5721c72 None None] Resource Port 6b2eeaac-b65e-4315-9e6b-2f3f7f643e90 updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6b2eeaac-b65e-4315-9e6b-2f3f7f643e90,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=6b2eeaac-b65e-4315-9e6b-2f3f7f643e90,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=6b2eeaac-b65e-4315-9e6b-2f3f7f643e90,segment=NetworkSegment(02e0c40d-c6ca-4ad2-9b3f-4b04b702f1ed),segment_id=02e0c40d-c6ca-4ad2-9b3f-4b04b702f1ed)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:00.873980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-49ca3a9f-60ca-436d-a8f0-7505b5721c72 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6b2eeaac-b65e-4315-9e6b-2f3f7f643e90), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:01.077892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['419b6762-0832-495f-98ee-a4ec35979ac6'] and devices down [] completed. Sep 30 09:52:01.078430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:433 - ports processed. Elapsed:0.622 Sep 30 09:52:01.079069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:433 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 1, 'removed': 0}}. Elapsed:0.623 Sep 30 09:52:01.216958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9169e316-e839-40dc-9001-1475f4040895 None None] Resource Port 6b2eeaac-b65e-4315-9e6b-2f3f7f643e90 updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:01.219365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9169e316-e839-40dc-9001-1475f4040895 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (6b2eeaac-b65e-4315-9e6b-2f3f7f643e90), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:01.349536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-616a0b83-f169-49a8-a132-011b03619761 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:52:00Z,data_plane_status=None,description='',device_id='bcd7505a-8f4d-4b0b-969e-776089b2e6d1',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c69dcca2-dd34-464e-98ba-2697ae2f9628,mac_address=fa:16:3e:58:3d:30,name='',network_id=3408b8b1-1a84-4fa0-8af6-da7419c2525d,numa_affinity_policy=,project_id='f0d0c96bbb304882b1f2459361551a93',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c69dcca2-dd34-464e-98ba-2697ae2f9628),security_group_ids=set([6fa83794-f114-4d02-9d65-747e3bcbcdb0]),status='DOWN',updated_at=2022-09-30T09:52:00Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:52:01.350363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-616a0b83-f169-49a8-a132-011b03619761 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c69dcca2-dd34-464e-98ba-2697ae2f9628), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:01.351035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-616a0b83-f169-49a8-a132-011b03619761 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group member updated {'6fa83794-f114-4d02-9d65-747e3bcbcdb0'} Sep 30 09:52:01.435510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bff25f27-3c9d-4090-927c-ea6afd163d51","insert","qr-6b2eeaac-b6",["set",[]],["map",[["attached-mac","fa:16:3e:38:23:ec"],["iface-id","6b2eeaac-b65e-4315-9e6b-2f3f7f643e90"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:52:01.458410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bff25f27-3c9d-4090-927c-ea6afd163d51","old",null,["set",[]],null],["","new","qr-6b2eeaac-b6",35,["map",[["attached-mac","fa:16:3e:38:23:ec"],["iface-id","6b2eeaac-b65e-4315-9e6b-2f3f7f643e90"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:52:02.146238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ff1a8eb9-5931-4285-8c78-51c84159712a tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:52:01Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8d7849f8-8e67-4398-8b1b-8662626b1602,mac_address=fa:16:3e:53:86:9d,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8d7849f8-8e67-4398-8b1b-8662626b1602),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T09:52:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:52:02.146238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ff1a8eb9-5931-4285-8c78-51c84159712a tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (8d7849f8-8e67-4398-8b1b-8662626b1602), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:02.234076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-702c23ab-1ccb-4f71-8166-b680a2369737 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:52:01Z,data_plane_status=None,description='',device_id='4ff7e4e2-632b-402b-b30d-c0916cb3b498',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=c95b82c7-207b-4532-98c9-cb356b1ea7fd,mac_address=fa:16:3e:ea:c7:73,name='',network_id=d038a068-f643-497f-8e6f-7d6e8fb5892b,numa_affinity_policy=,project_id='86e6b0501cb94028be07bddd2182638b',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(c95b82c7-207b-4532-98c9-cb356b1ea7fd),security_group_ids=set([91ed8715-2dc6-4013-a8e5-1d4a5ad44d27]),status='DOWN',updated_at=2022-09-30T09:52:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:52:02.234840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-702c23ab-1ccb-4f71-8166-b680a2369737 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c95b82c7-207b-4532-98c9-cb356b1ea7fd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:02.235530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-702c23ab-1ccb-4f71-8166-b680a2369737 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group member updated {'91ed8715-2dc6-4013-a8e5-1d4a5ad44d27'} Sep 30 09:52:02.457962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:434 started Sep 30 09:52:02.460933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0562,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=960000000,duration_sec=880,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:02.465898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:02.465898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:434 - starting polling. Elapsed:0.004 Sep 30 09:52:02.465898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:02.469721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:434 - port information retrieved. Elapsed:0.012 Sep 30 09:52:02.470059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '94897731-51b0-456e-b633-f954a65edcca', '6b2eeaac-b65e-4315-9e6b-2f3f7f643e90', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '419b6762-0832-495f-98ee-a4ec35979ac6', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': {'6b2eeaac-b65e-4315-9e6b-2f3f7f643e90'}, 'removed': set(), 'updated': {'6b2eeaac-b65e-4315-9e6b-2f3f7f643e90'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:52:02.470636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '6b2eeaac-b65e-4315-9e6b-2f3f7f643e90', 'device_id': '2638e8e4-8e6c-4d9d-821c-9e13d40cad6e', 'network_id': '6555801d-cf6b-484f-a48c-039d4395e1ca', 'port_id': '6b2eeaac-b65e-4315-9e6b-2f3f7f643e90', 'mac_address': 'fa:16:3e:38:23:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '33641e3b-dbf8-48b8-92c8-d70b8e4cb83e', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:52:02.474366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 6b2eeaac-b65e-4315-9e6b-2f3f7f643e90 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:52:02.474716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 6b2eeaac-b65e-4315-9e6b-2f3f7f643e90 updated. Details: {'device': '6b2eeaac-b65e-4315-9e6b-2f3f7f643e90', 'device_id': '2638e8e4-8e6c-4d9d-821c-9e13d40cad6e', 'network_id': '6555801d-cf6b-484f-a48c-039d4395e1ca', 'port_id': '6b2eeaac-b65e-4315-9e6b-2f3f7f643e90', 'mac_address': 'fa:16:3e:38:23:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 391, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': '33641e3b-dbf8-48b8-92c8-d70b8e4cb83e', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 13} Sep 30 09:52:02.475732 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6b2eeaac-b6, col_values=(('tag', 13),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:52:02.476856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-6b2eeaac-b6, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:52:02.477298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-6b2eeaac-b6, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:52:02.483835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6b2eeaac-b6, col_values=(('other_config', {'net_uuid': '6555801d-cf6b-484f-a48c-039d4395e1ca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '13', 'segmentation_id': '391'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:52:02.493885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0564,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:02.500151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:434 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 22 devices currently available. Time elapsed: 0.024 Sep 30 09:52:02.500151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:52:02.500151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'6b2eeaac-b65e-4315-9e6b-2f3f7f643e90'} Sep 30 09:52:02.500151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:52:02.500151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:52:02.503712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:52:02.570276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[495081e6-5f13-4a2c-b1dc-976bcc97e482]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:52:02.570951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:434 - agent port security group processed in 0.100 Sep 30 09:52:02.571787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 6b2eeaac-b65e-4315-9e6b-2f3f7f643e90 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:52:02.755810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-16fca9e2-7ccb-40a8-abeb-4b7077a0ff78 service neutron] Resource Port c69dcca2-dd34-464e-98ba-2697ae2f9628 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=c69dcca2-dd34-464e-98ba-2697ae2f9628,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c69dcca2-dd34-464e-98ba-2697ae2f9628,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:02.755810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-16fca9e2-7ccb-40a8-abeb-4b7077a0ff78 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c69dcca2-dd34-464e-98ba-2697ae2f9628), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:02.785237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['6b2eeaac-b65e-4315-9e6b-2f3f7f643e90'] and devices down [] completed. Sep 30 09:52:02.785482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:434 - ports processed. Elapsed:0.328 Sep 30 09:52:02.785821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:434 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.328 Sep 30 09:52:02.995431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ff1a8eb9-5931-4285-8c78-51c84159712a tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource Port 8d7849f8-8e67-4398-8b1b-8662626b1602 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'a036f4f7-f1f9-41f4-b2c7-1e5c2216a3fe'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:02.995890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ff1a8eb9-5931-4285-8c78-51c84159712a tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (8d7849f8-8e67-4398-8b1b-8662626b1602), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:03.436777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ac22c257-7c84-4498-81cf-9cae0ce1d6d3 service neutron] Resource Port c95b82c7-207b-4532-98c9-cb356b1ea7fd updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=c95b82c7-207b-4532-98c9-cb356b1ea7fd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c95b82c7-207b-4532-98c9-cb356b1ea7fd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:03.437495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ac22c257-7c84-4498-81cf-9cae0ce1d6d3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c95b82c7-207b-4532-98c9-cb356b1ea7fd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:03.732379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-16fca9e2-7ccb-40a8-abeb-4b7077a0ff78 service neutron] Resource Port c69dcca2-dd34-464e-98ba-2697ae2f9628 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c69dcca2-dd34-464e-98ba-2697ae2f9628,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c69dcca2-dd34-464e-98ba-2697ae2f9628,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=c69dcca2-dd34-464e-98ba-2697ae2f9628,segment=NetworkSegment(765b8827-dc41-4d9e-be01-6115a3b03c81),segment_id=765b8827-dc41-4d9e-be01-6115a3b03c81)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:03.732776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-16fca9e2-7ccb-40a8-abeb-4b7077a0ff78 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c69dcca2-dd34-464e-98ba-2697ae2f9628), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:03.830014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ac22c257-7c84-4498-81cf-9cae0ce1d6d3 service neutron] Resource Port c95b82c7-207b-4532-98c9-cb356b1ea7fd updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c95b82c7-207b-4532-98c9-cb356b1ea7fd,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=c95b82c7-207b-4532-98c9-cb356b1ea7fd,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=c95b82c7-207b-4532-98c9-cb356b1ea7fd,segment=NetworkSegment(e6b17fb5-eb11-41c5-b8ac-1188c97e0520),segment_id=e6b17fb5-eb11-41c5-b8ac-1188c97e0520)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:03.830520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ac22c257-7c84-4498-81cf-9cae0ce1d6d3 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c95b82c7-207b-4532-98c9-cb356b1ea7fd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:04.459126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:435 started Sep 30 09:52:04.461953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0566,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=962000000,duration_sec=882,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:04.462652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:04.463290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:435 - starting polling. Elapsed:0.004 Sep 30 09:52:04.466172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:04.470201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:435 - port information retrieved. Elapsed:0.011 Sep 30 09:52:04.474467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:435 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 30 09:52:04.850033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-28fca574-b3d6-476c-8692-7803896337ae tempest-VolumesSnapshotTestJSON-1827020212 tempest-VolumesSnapshotTestJSON-1827020212-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:52:03Z,data_plane_status=None,description='',device_id='0d748a97-9d22-4676-b253-1ff841288220',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=ab1411b2-93da-4dea-aed5-b2432b7055d1,mac_address=fa:16:3e:7a:c3:40,name='',network_id=70073525-5499-4f0a-9017-eb0ecf8cf458,numa_affinity_policy=,project_id='b3db64185ae94cefa4efa6f3e03c2f7e',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(ab1411b2-93da-4dea-aed5-b2432b7055d1),security_group_ids=set([5d4b07af-fe86-47c7-ac14-1ea489912242]),status='DOWN',updated_at=2022-09-30T09:52:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:52:04.851137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-28fca574-b3d6-476c-8692-7803896337ae tempest-VolumesSnapshotTestJSON-1827020212 tempest-VolumesSnapshotTestJSON-1827020212-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (ab1411b2-93da-4dea-aed5-b2432b7055d1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:04.852378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-28fca574-b3d6-476c-8692-7803896337ae tempest-VolumesSnapshotTestJSON-1827020212 tempest-VolumesSnapshotTestJSON-1827020212-project] Security group member updated {'5d4b07af-fe86-47c7-ac14-1ea489912242'} Sep 30 09:52:05.894366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4b61dbe8-eda2-403a-9b15-d406ee62b0b7 service neutron] Resource Port ab1411b2-93da-4dea-aed5-b2432b7055d1 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=ab1411b2-93da-4dea-aed5-b2432b7055d1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=ab1411b2-93da-4dea-aed5-b2432b7055d1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:05.898712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4b61dbe8-eda2-403a-9b15-d406ee62b0b7 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (ab1411b2-93da-4dea-aed5-b2432b7055d1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:06.419360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4b61dbe8-eda2-403a-9b15-d406ee62b0b7 service neutron] Resource Port ab1411b2-93da-4dea-aed5-b2432b7055d1 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=ab1411b2-93da-4dea-aed5-b2432b7055d1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=ab1411b2-93da-4dea-aed5-b2432b7055d1,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=ab1411b2-93da-4dea-aed5-b2432b7055d1,segment=NetworkSegment(d4d12f31-d9ff-4a87-9234-3f21f2c5f3a3),segment_id=d4d12f31-d9ff-4a87-9234-3f21f2c5f3a3)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:06.422848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4b61dbe8-eda2-403a-9b15-d406ee62b0b7 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (ab1411b2-93da-4dea-aed5-b2432b7055d1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:06.460239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:436 started Sep 30 09:52:06.464855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0568,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=963000000,duration_sec=884,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:06.465440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:06.465767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:436 - starting polling. Elapsed:0.006 Sep 30 09:52:06.470089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:06.474718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:436 - port information retrieved. Elapsed:0.015 Sep 30 09:52:06.475239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:436 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 30 09:52:08.460932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:437 started Sep 30 09:52:08.463596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c056a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=963000000,duration_sec=886,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:08.465317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:08.465866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:437 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:52:08.576528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port c95b82c7-207b-4532-98c9-cb356b1ea7fd updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:08.576898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c95b82c7-207b-4532-98c9-cb356b1ea7fd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:09.295541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-445665db-a7d4-4de7-a940-cf39eda9aa5d tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:52:08Z,data_plane_status=None,description='',device_id='dbe90c99-924b-4f03-85d5-4bfa0a6cd051',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=869788d7-cd2f-4701-b6bd-a6f79a97b732,mac_address=fa:16:3e:d6:33:96,name='',network_id=6555801d-cf6b-484f-a48c-039d4395e1ca,numa_affinity_policy=,project_id='1142014cc9284cf1833e5bfbcdb41599',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(869788d7-cd2f-4701-b6bd-a6f79a97b732),security_group_ids=set([951ad8ca-ad5f-4420-bbe5-c5c64ad050b4]),status='DOWN',updated_at=2022-09-30T09:52:08Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:52:09.301113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-445665db-a7d4-4de7-a940-cf39eda9aa5d tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (869788d7-cd2f-4701-b6bd-a6f79a97b732), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:09.302039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-445665db-a7d4-4de7-a940-cf39eda9aa5d tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group member updated {'951ad8ca-ad5f-4420-bbe5-c5c64ad050b4'} Sep 30 09:52:09.888304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2da55e2a-cde8-43e2-8a0f-a5a6e6727692 service neutron] Resource Port 869788d7-cd2f-4701-b6bd-a6f79a97b732 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=869788d7-cd2f-4701-b6bd-a6f79a97b732,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=869788d7-cd2f-4701-b6bd-a6f79a97b732,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:09.888951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2da55e2a-cde8-43e2-8a0f-a5a6e6727692 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (869788d7-cd2f-4701-b6bd-a6f79a97b732), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:10.462767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:438 started Sep 30 09:52:10.465304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c056c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=964000000,duration_sec=888,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:10.465901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:10.466241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:438 - starting polling. Elapsed:0.005 Sep 30 09:52:10.469375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:10.476472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:438 - port information retrieved. Elapsed:0.015 Sep 30 09:52:10.478762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:438 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 30 09:52:10.528893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2da55e2a-cde8-43e2-8a0f-a5a6e6727692 service neutron] Resource Port 869788d7-cd2f-4701-b6bd-a6f79a97b732 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=869788d7-cd2f-4701-b6bd-a6f79a97b732,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=869788d7-cd2f-4701-b6bd-a6f79a97b732,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=869788d7-cd2f-4701-b6bd-a6f79a97b732,segment=NetworkSegment(02e0c40d-c6ca-4ad2-9b3f-4b04b702f1ed),segment_id=02e0c40d-c6ca-4ad2-9b3f-4b04b702f1ed)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:10.528893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2da55e2a-cde8-43e2-8a0f-a5a6e6727692 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (869788d7-cd2f-4701-b6bd-a6f79a97b732), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:10.731053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port ab1411b2-93da-4dea-aed5-b2432b7055d1 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:10.733504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (ab1411b2-93da-4dea-aed5-b2432b7055d1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:10.790173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port c95b82c7-207b-4532-98c9-cb356b1ea7fd updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:10.791381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c95b82c7-207b-4532-98c9-cb356b1ea7fd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:12.464970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:439 started Sep 30 09:52:12.467916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c056e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=967000000,duration_sec=890,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:12.468598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:12.469313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:439 - starting polling. Elapsed:0.004 Sep 30 09:52:12.471799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:12.478662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:439 - port information retrieved. Elapsed:0.012 Sep 30 09:52:12.478662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:439 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 30 09:52:12.676832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port ab1411b2-93da-4dea-aed5-b2432b7055d1 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:12.677219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (ab1411b2-93da-4dea-aed5-b2432b7055d1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:14.465948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:440 started Sep 30 09:52:14.468922 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0570,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=969000000,duration_sec=892,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:14.469895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:14.470318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:440 - starting polling. Elapsed:0.005 Sep 30 09:52:14.473477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:14.479772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:440 - port information retrieved. Elapsed:0.012 Sep 30 09:52:14.480121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:440 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 30 09:52:14.689752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port c69dcca2-dd34-464e-98ba-2697ae2f9628 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:14.690126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c69dcca2-dd34-464e-98ba-2697ae2f9628), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:16.467415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:441 started Sep 30 09:52:16.469885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0572,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=970000000,duration_sec=894,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:16.470458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:16.470978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:441 - starting polling. Elapsed:0.004 Sep 30 09:52:16.473842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:16.477832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:441 - port information retrieved. Elapsed:0.011 Sep 30 09:52:16.478168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:441 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:52:17.111103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 869788d7-cd2f-4701-b6bd-a6f79a97b732 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:17.111481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (869788d7-cd2f-4701-b6bd-a6f79a97b732), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:17.250169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port c69dcca2-dd34-464e-98ba-2697ae2f9628 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:17.251539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (c69dcca2-dd34-464e-98ba-2697ae2f9628), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:17.579843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 803fcd8d-66b3-48a0-bc79-84c2e79f336c updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:17.580530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (803fcd8d-66b3-48a0-bc79-84c2e79f336c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:18.468183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:442 started Sep 30 09:52:18.470655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0574,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=970000000,duration_sec=896,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:18.471269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:18.471606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:442 - starting polling. Elapsed:0.004 Sep 30 09:52:18.474394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:18.478277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:442 - port information retrieved. Elapsed:0.010 Sep 30 09:52:18.478843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:442 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:52:18.737829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 869788d7-cd2f-4701-b6bd-a6f79a97b732 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:18.738440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (869788d7-cd2f-4701-b6bd-a6f79a97b732), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:20.469194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:443 started Sep 30 09:52:20.471793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0576,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=972000000,duration_sec=898,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:20.472439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:20.472846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:443 - starting polling. Elapsed:0.004 Sep 30 09:52:20.475840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:20.479814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:443 - port information retrieved. Elapsed:0.011 Sep 30 09:52:20.480216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:443 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:52:21.252489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e9490963-db76-44e2-ad89-46222f19b7c6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:52:20Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5bfa79fa-834c-44fe-ba53-34a1f807779e,mac_address=fa:16:3e:5e:0e:ed,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5bfa79fa-834c-44fe-ba53-34a1f807779e),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T09:52:20Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:52:21.255550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e9490963-db76-44e2-ad89-46222f19b7c6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5bfa79fa-834c-44fe-ba53-34a1f807779e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:22.036227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e9490963-db76-44e2-ad89-46222f19b7c6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource Port 5bfa79fa-834c-44fe-ba53-34a1f807779e updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '4fc91e4a-44df-4278-951d-53901916f41f'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:22.036763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e9490963-db76-44e2-ad89-46222f19b7c6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5bfa79fa-834c-44fe-ba53-34a1f807779e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:22.470614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:444 started Sep 30 09:52:22.473152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0578,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=973000000,duration_sec=900,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:22.473933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:22.474585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:444 - starting polling. Elapsed:0.004 Sep 30 09:52:22.477148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:22.481545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:444 - port information retrieved. Elapsed:0.011 Sep 30 09:52:22.485587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:444 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:52:24.471309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:445 started Sep 30 09:52:24.474096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c057a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=974000000,duration_sec=902,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:24.474677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:24.475025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:445 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:52:26.472329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:446 started Sep 30 09:52:26.474749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c057c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=975000000,duration_sec=904,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:26.476155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:26.476155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:446 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:52:28.473014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:447 started Sep 30 09:52:28.475558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c057e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=975000000,duration_sec=906,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:28.476132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:28.476474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:447 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:52:30.473945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:448 started Sep 30 09:52:30.476483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0580,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=976000000,duration_sec=908,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:30.477050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:30.477402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:448 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:52:31.587738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 803fcd8d-66b3-48a0-bc79-84c2e79f336c updated (revision_number 6->7). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:31.588379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (803fcd8d-66b3-48a0-bc79-84c2e79f336c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:32.474856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:449 started Sep 30 09:52:32.477281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0582,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=977000000,duration_sec=910,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:32.477854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:32.478187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:449 - starting polling. Elapsed:0.004 Sep 30 09:52:32.482527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:32.486381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:449 - port information retrieved. Elapsed:0.012 Sep 30 09:52:32.486743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:449 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 30 09:52:34.475665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:450 started Sep 30 09:52:34.478187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0584,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=978000000,duration_sec=912,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:34.479316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:34.479666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:450 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:52:36.476882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:451 started Sep 30 09:52:36.480447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0586,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=980000000,duration_sec=914,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:36.481020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:36.481384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:451 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:52:36.952905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 803fcd8d-66b3-48a0-bc79-84c2e79f336c updated (revision_number 7->8). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:52:36.953605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (803fcd8d-66b3-48a0-bc79-84c2e79f336c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:38.478254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:452 started Sep 30 09:52:38.480620 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0588,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=980000000,duration_sec=916,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:38.481183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:38.481536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:452 - starting polling. Elapsed:0.003 Sep 30 09:52:38.484489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:38.489941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:452 - port information retrieved. Elapsed:0.010 Sep 30 09:52:38.489941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:452 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:52:40.479112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:453 started Sep 30 09:52:40.482073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c058a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=981000000,duration_sec=918,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:40.482689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:40.483035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:453 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:52:42.480109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:454 started Sep 30 09:52:42.482550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c058c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=982000000,duration_sec=920,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:42.483815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:42.491108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:454 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:52:44.481510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:455 started Sep 30 09:52:44.483938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c058e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=984000000,duration_sec=922,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:44.484531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:44.484882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:455 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:52:46.485321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:456 started Sep 30 09:52:46.485905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0590,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=985000000,duration_sec=924,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:46.486441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:46.486936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:456 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:52:46.745366 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0254db75-8a62-409e-8208-e59706aa4156 tempest-VolumesSnapshotTestJSON-1827020212 tempest-VolumesSnapshotTestJSON-1827020212-project] Resource Port deleted: ab1411b2-93da-4dea-aed5-b2432b7055d1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:52:46.745917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0254db75-8a62-409e-8208-e59706aa4156 tempest-VolumesSnapshotTestJSON-1827020212 tempest-VolumesSnapshotTestJSON-1827020212-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (ab1411b2-93da-4dea-aed5-b2432b7055d1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:46.746520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0254db75-8a62-409e-8208-e59706aa4156 tempest-VolumesSnapshotTestJSON-1827020212 tempest-VolumesSnapshotTestJSON-1827020212-project] Security group member updated {'5d4b07af-fe86-47c7-ac14-1ea489912242'} Sep 30 09:52:48.483818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:457 started Sep 30 09:52:48.486846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0592,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=987000000,duration_sec=926,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:48.487413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:48.487746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:457 - starting polling. Elapsed:0.004 Sep 30 09:52:48.490572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:52:48.492535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port ab1411b2-93da-4dea-aed5-b2432b7055d1 not present in bridge br-int Sep 30 09:52:48.492898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:52:48.493145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['ab1411b2-93da-4dea-aed5-b2432b7055d1'] Sep 30 09:52:48.493464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port ab1411b2-93da-4dea-aed5-b2432b7055d1 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:52:48.497280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:457 - port information retrieved. Elapsed:0.014 Sep 30 09:52:48.497611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:457 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 30 09:52:50.485055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:458 started Sep 30 09:52:50.487574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0594,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=987000000,duration_sec=928,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:50.488140 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:50.488522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:458 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:52:52.485964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:459 started Sep 30 09:52:52.488364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0596,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=988000000,duration_sec=930,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:52.488980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:52.489327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:459 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:52:54.487305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:460 started Sep 30 09:52:54.489687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0598,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=990000000,duration_sec=932,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:54.490250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:54.490612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:460 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:52:56.488084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:461 started Sep 30 09:52:56.490568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c059a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=990000000,duration_sec=934,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:56.491164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:56.491541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:461 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:52:58.489664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:462 started Sep 30 09:52:58.492058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c059c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=992000000,duration_sec=936,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:52:58.492618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:52:58.492963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:462 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:00.490930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:463 started Sep 30 09:53:00.493331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c059e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=993000000,duration_sec=938,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:00.493896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:00.494349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:463 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:02.491888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:464 started Sep 30 09:53:02.494381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=994000000,duration_sec=940,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:02.495011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:02.495364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:464 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:04.492981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:465 started Sep 30 09:53:04.495542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=995000000,duration_sec=942,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:04.496105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:04.496450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:465 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:06.493196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:466 started Sep 30 09:53:06.496043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=996000000,duration_sec=944,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:06.496604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:06.496952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:466 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:08.493925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:467 started Sep 30 09:53:08.496818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=996000000,duration_sec=946,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:08.497394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:08.497748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:467 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:10.494902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:468 started Sep 30 09:53:10.497656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=997000000,duration_sec=948,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:10.498215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:10.498567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:468 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:12.495920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:469 started Sep 30 09:53:12.498347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=998000000,duration_sec=950,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:12.498940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:12.499318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:469 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:14.496664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:470 started Sep 30 09:53:14.499219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=999000000,duration_sec=952,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:14.499780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:14.500126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:470 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:14.636032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-54976420-2641-4060-93b3-d8bcfd7f37cc admin admin] Resource Subnet deleted: 2e053116-efc1-4be8-a3be-3b29e4f3d43e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:14.636400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-54976420-2641-4060-93b3-d8bcfd7f37cc admin admin] Publish callbacks [] for Subnet (2e053116-efc1-4be8-a3be-3b29e4f3d43e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:14.999472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-12953a3e-ce68-44f5-9a1d-76b28e23cc55 admin admin] Resource Network deleted: 70073525-5499-4f0a-9017-eb0ecf8cf458 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:14.999972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-12953a3e-ce68-44f5-9a1d-76b28e23cc55 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (70073525-5499-4f0a-9017-eb0ecf8cf458), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:15.678930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Resource SecurityGroup deleted: 5d4b07af-fe86-47c7-ac14-1ea489912242 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:15.679547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (5d4b07af-fe86-47c7-ac14-1ea489912242), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:15.679779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5d4b07af-fe86-47c7-ac14-1ea489912242',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:53:15.693902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5d4b07af-fe86-47c7-ac14-1ea489912242',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:53:15.694433 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Resource SecurityGroupRule deleted: 1a8663ea-5986-433b-a6b3-8083c5266206 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:15.694884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (1a8663ea-5986-433b-a6b3-8083c5266206), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:15.695370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Security group rule updated ['5d4b07af-fe86-47c7-ac14-1ea489912242'] Sep 30 09:53:15.695896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Resource SecurityGroupRule deleted: 4bca92b1-88f3-402b-b8ad-32f4850aa565 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:15.696250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4bca92b1-88f3-402b-b8ad-32f4850aa565), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:15.696578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Security group rule updated ['5d4b07af-fe86-47c7-ac14-1ea489912242'] Sep 30 09:53:15.696947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Resource SecurityGroupRule deleted: 5639f81a-cfcc-48c2-9762-4aa673521456 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:15.697291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5639f81a-cfcc-48c2-9762-4aa673521456), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:15.697609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Security group rule updated ['5d4b07af-fe86-47c7-ac14-1ea489912242'] Sep 30 09:53:15.698016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Resource SecurityGroupRule deleted: 8af735cf-2210-46b5-8c03-8314b260dd29 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:15.698362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8af735cf-2210-46b5-8c03-8314b260dd29), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:15.698705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-90562a6e-e56b-4481-9cfb-388549513614 admin admin] Security group rule updated ['5d4b07af-fe86-47c7-ac14-1ea489912242'] Sep 30 09:53:16.497444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:471 started Sep 30 09:53:16.499884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=0,duration_sec=955,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:16.500454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:16.500803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:471 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:18.498213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:472 started Sep 30 09:53:18.500671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=1000000,duration_sec=957,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:18.501244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:18.501596 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:472 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:18.923601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9d7e4751-3ea9-4ee5-8152-7e67e1294f07 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource Port deleted: c95b82c7-207b-4532-98c9-cb356b1ea7fd {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:18.924634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9d7e4751-3ea9-4ee5-8152-7e67e1294f07 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (c95b82c7-207b-4532-98c9-cb356b1ea7fd), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:18.925105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9d7e4751-3ea9-4ee5-8152-7e67e1294f07 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group member updated {'91ed8715-2dc6-4013-a8e5-1d4a5ad44d27'} Sep 30 09:53:20.499440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:473 started Sep 30 09:53:20.502580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=2000000,duration_sec=959,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:20.503210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:20.503541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:473 - starting polling. Elapsed:0.004 Sep 30 09:53:20.506773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:20.508839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port c95b82c7-207b-4532-98c9-cb356b1ea7fd not present in bridge br-int Sep 30 09:53:20.509131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:53:20.509420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['c95b82c7-207b-4532-98c9-cb356b1ea7fd'] Sep 30 09:53:20.509728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port c95b82c7-207b-4532-98c9-cb356b1ea7fd is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:53:20.513526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:473 - port information retrieved. Elapsed:0.014 Sep 30 09:53:20.520964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:473 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 30 09:53:21.481517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroup deleted: 91ed8715-2dc6-4013-a8e5-1d4a5ad44d27 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:21.481880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (91ed8715-2dc6-4013-a8e5-1d4a5ad44d27), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:21.482329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('91ed8715-2dc6-4013-a8e5-1d4a5ad44d27',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:53:21.496486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('91ed8715-2dc6-4013-a8e5-1d4a5ad44d27',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:53:21.497138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: 3c5e1c22-bfdc-4900-ad7a-1a84f4e023d6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:21.497826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (3c5e1c22-bfdc-4900-ad7a-1a84f4e023d6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:21.498482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['91ed8715-2dc6-4013-a8e5-1d4a5ad44d27'] Sep 30 09:53:21.499175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: 44cbeae4-fed1-45e4-98e1-dbc6c4711f3a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:21.499750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (44cbeae4-fed1-45e4-98e1-dbc6c4711f3a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:21.500335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['91ed8715-2dc6-4013-a8e5-1d4a5ad44d27'] Sep 30 09:53:21.500612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: 8a83e4ec-9947-4351-83aa-014898ac5a8b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:21.501076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8a83e4ec-9947-4351-83aa-014898ac5a8b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:21.501575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['91ed8715-2dc6-4013-a8e5-1d4a5ad44d27'] Sep 30 09:53:21.502320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource SecurityGroupRule deleted: 96c9aea8-bdcc-4f77-81c7-ff3dd52013c1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:21.502823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (96c9aea8-bdcc-4f77-81c7-ff3dd52013c1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:21.503569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f16ea995-70d4-4088-8f82-be6bf62245e6 tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Security group rule updated ['91ed8715-2dc6-4013-a8e5-1d4a5ad44d27'] Sep 30 09:53:21.952483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b4c65911-816f-462e-8959-5d0f1d02f07e tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Resource Port deleted: 29037efc-20a5-4ae7-aabd-5ff75de505f6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:21.952933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b4c65911-816f-462e-8959-5d0f1d02f07e tempest-AttachVolumeNegativeTest-2023202984 tempest-AttachVolumeNegativeTest-2023202984-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (29037efc-20a5-4ae7-aabd-5ff75de505f6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:22.500638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:474 started Sep 30 09:53:22.503951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=3000000,duration_sec=961,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:22.504519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:22.504851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:474 - starting polling. Elapsed:0.004 Sep 30 09:53:22.507715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:22.509653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 29037efc-20a5-4ae7-aabd-5ff75de505f6 not present in bridge br-int Sep 30 09:53:22.509980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:53:22.510263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['29037efc-20a5-4ae7-aabd-5ff75de505f6'] Sep 30 09:53:22.510577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 29037efc-20a5-4ae7-aabd-5ff75de505f6 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:53:22.514332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:474 - port information retrieved. Elapsed:0.014 Sep 30 09:53:22.514682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:474 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 30 09:53:24.503090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:475 started Sep 30 09:53:24.505506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=5000000,duration_sec=963,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:24.506096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:24.506440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:475 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:26.503506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:476 started Sep 30 09:53:26.506183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05b8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=6000000,duration_sec=965,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:26.506778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:26.507127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:476 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:27.302798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ef7700fe-17f9-4246-87de-9cc5425a5cf4 admin admin] Resource Port deleted: 7e5680a6-21b5-4615-b9b3-c87cec4453e7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:27.303174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ef7700fe-17f9-4246-87de-9cc5425a5cf4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (7e5680a6-21b5-4615-b9b3-c87cec4453e7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:28.504107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:477 started Sep 30 09:53:28.506812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05ba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=6000000,duration_sec=967,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:28.507659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:28.507996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:477 - starting polling. Elapsed:0.004 Sep 30 09:53:28.511748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:28.514855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-7e5680a6-21, col_values=(('tag', 4095),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:53:28.522096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c05bc,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:28.522719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['7e5680a6-21b5-4615-b9b3-c87cec4453e7'] Sep 30 09:53:28.523327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:53:28.559694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d50f1a0-a282-420c-aec3-25959bc7e97d]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:53:28.564022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:477 - port information retrieved. Elapsed:0.060 Sep 30 09:53:28.564396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:477 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.060 Sep 30 09:53:28.695067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a4f1c8ff-1eb5-420f-a319-42aaf46a5f07","delete","qr-7e5680a6-21",14,["map",[["attached-mac","fa:16:3e:59:a9:c5"],["iface-id","7e5680a6-21b5-4615-b9b3-c87cec4453e7"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:53:28.981047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3f43bf09-8995-466a-91b8-4e5e08c208b0 admin admin] Resource Port deleted: a814a09a-4d8f-4407-894b-fc4aa5feb85d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:28.981047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3f43bf09-8995-466a-91b8-4e5e08c208b0 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (a814a09a-4d8f-4407-894b-fc4aa5feb85d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:29.368794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["0b6c23fc-8389-4970-9715-0124cc52b79c","delete","qg-a814a09a-4d",11,["map",[["attached-mac","fa:16:3e:f9:c2:fe"],["iface-id","a814a09a-4d8f-4407-894b-fc4aa5feb85d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:53:29.580634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dd183187-6fd5-4a33-9259-1995f2b35bfb admin admin] Resource Subnet deleted: 6f2733e7-5dbc-4e5f-b1d7-072b1b8aee4d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:29.581720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dd183187-6fd5-4a33-9259-1995f2b35bfb admin admin] Publish callbacks [] for Subnet (6f2733e7-5dbc-4e5f-b1d7-072b1b8aee4d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:29.713824 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6dcb3477-9ed3-4c33-8388-11f5029d8408","delete","tap3291eabc-84",8,["map",[["attached-mac","fa:16:3e:ba:74:cd"],["iface-id","3291eabc-8476-48e1-90b3-0e49bcde606a"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:53:29.962942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7004a73a-33a6-4153-9c84-5652e74c6e7d admin admin] Resource Port deleted: 3291eabc-8476-48e1-90b3-0e49bcde606a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:29.963380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7004a73a-33a6-4153-9c84-5652e74c6e7d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (3291eabc-8476-48e1-90b3-0e49bcde606a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:29.967931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1bf79f0e-abf3-4816-b8e3-423ea9bc515b None None] Resource Port deleted: 3291eabc-8476-48e1-90b3-0e49bcde606a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:29.972095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1bf79f0e-abf3-4816-b8e3-423ea9bc515b None None] Skipped duplicate delete event for 3291eabc-8476-48e1-90b3-0e49bcde606a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 30 09:53:30.237817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7004a73a-33a6-4153-9c84-5652e74c6e7d admin admin] Resource Network deleted: d038a068-f643-497f-8e6f-7d6e8fb5892b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:30.238287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7004a73a-33a6-4153-9c84-5652e74c6e7d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (d038a068-f643-497f-8e6f-7d6e8fb5892b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:30.505233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:478 started Sep 30 09:53:30.507758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05be,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=8000000,duration_sec=969,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:30.508331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:30.509022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:478 - starting polling. Elapsed:0.004 Sep 30 09:53:30.511456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:30.516521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c05c0,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 8}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:30.518829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c05c2,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 11}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:30.522000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c05c4,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 14}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:30.522000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:478 - port information retrieved. Elapsed:0.016 Sep 30 09:53:30.522249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '5ce7c4c9-91a6-4157-b354-718efb743f8e', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '94897731-51b0-456e-b633-f954a65edcca', '6b2eeaac-b65e-4315-9e6b-2f3f7f643e90', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '419b6762-0832-495f-98ee-a4ec35979ac6', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:53:30.522249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:478 - agent port security group processed in 0.000 Sep 30 09:53:30.523749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:53:30.524049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d'} Sep 30 09:53:30.524427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 7e5680a6-21b5-4615-b9b3-c87cec4453e7 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:53:30.524869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 8 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:53:30.563213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7e4dad-d69c-4bf2-a86d-48c836562324]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:53:30.563831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'3291eabc-8476-48e1-90b3-0e49bcde606a', '7e5680a6-21b5-4615-b9b3-c87cec4453e7', 'a814a09a-4d8f-4407-894b-fc4aa5feb85d'} removed Sep 30 09:53:30.635221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:53:30.635221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Reclaiming vlan = 5 from net-id = d038a068-f643-497f-8e6f-7d6e8fb5892b, seg-id = 392 Sep 30 09:53:30.637832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xc9105f06,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16864421859504038737,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4101}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:30.640322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xf1c05c6,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4488}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:30.640857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:53:30.641227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:478 - treat_devices_removed completed in 0.117 Sep 30 09:53:30.641516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:478 - ports processed. Elapsed:0.136 Sep 30 09:53:30.641829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:478 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.137 Sep 30 09:53:30.864113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Resource SecurityGroup deleted: 25b84d94-8875-4bc4-b8d2-6a7836938f01 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:30.864661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (25b84d94-8875-4bc4-b8d2-6a7836938f01), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:30.865248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('25b84d94-8875-4bc4-b8d2-6a7836938f01',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:53:30.878637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('25b84d94-8875-4bc4-b8d2-6a7836938f01',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:53:30.885333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Resource SecurityGroupRule deleted: 31a286f4-99f3-4fca-97eb-d4feacdcea74 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:30.885333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (31a286f4-99f3-4fca-97eb-d4feacdcea74), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:30.885333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Security group rule updated ['25b84d94-8875-4bc4-b8d2-6a7836938f01'] Sep 30 09:53:30.885333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Resource SecurityGroupRule deleted: 4d97f982-0680-4030-849f-e2eb36a887f1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:30.885333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4d97f982-0680-4030-849f-e2eb36a887f1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:30.885841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Security group rule updated ['25b84d94-8875-4bc4-b8d2-6a7836938f01'] Sep 30 09:53:30.885841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Resource SecurityGroupRule deleted: 5eb56400-0672-4474-a1d4-f54586e24277 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:30.885841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5eb56400-0672-4474-a1d4-f54586e24277), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:30.885841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Security group rule updated ['25b84d94-8875-4bc4-b8d2-6a7836938f01'] Sep 30 09:53:30.885841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Resource SecurityGroupRule deleted: c8315914-f464-4dd1-8244-53ca9d565a69 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:30.886245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c8315914-f464-4dd1-8244-53ca9d565a69), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:30.886245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-46c54226-2e15-4c4f-a5c6-c2fdaeece6fa admin admin] Security group rule updated ['25b84d94-8875-4bc4-b8d2-6a7836938f01'] Sep 30 09:53:32.168214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:53:32Z,description='Default security group',id=08296d99-906d-4dfc-8732-70e8f5f4be1e,is_default=True,name='default',project_id='dbda51b7423b4c4980a31fe5f1ecaef3',revision_number=1,rules=[SecurityGroupRule(04814acd-4e2a-4945-acef-400e5f4f4986),SecurityGroupRule(55bf0f18-6949-448f-b989-29fef278ddd4),SecurityGroupRule(5c63ff60-0c7c-4555-8fd6-ae211e277e90),SecurityGroupRule(86e9684f-7b09-49c6-8509-da82119368e0)],shared=False,stateful=True,updated_at=2022-09-30T09:53:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:32.168785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (08296d99-906d-4dfc-8732-70e8f5f4be1e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:32.169208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:32Z,description=,direction='ingress',ethertype='IPv4',id=04814acd-4e2a-4945-acef-400e5f4f4986,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dbda51b7423b4c4980a31fe5f1ecaef3',protocol=,remote_address_group_id=,remote_group_id=08296d99-906d-4dfc-8732-70e8f5f4be1e,remote_ip_prefix=,revision_number=0,security_group_id=08296d99-906d-4dfc-8732-70e8f5f4be1e,updated_at=2022-09-30T09:53:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:32.169581 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (04814acd-4e2a-4945-acef-400e5f4f4986), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:32.169918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Security group rule updated ['08296d99-906d-4dfc-8732-70e8f5f4be1e'] Sep 30 09:53:32.170585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:32Z,description=,direction='egress',ethertype='IPv4',id=55bf0f18-6949-448f-b989-29fef278ddd4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dbda51b7423b4c4980a31fe5f1ecaef3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=08296d99-906d-4dfc-8732-70e8f5f4be1e,updated_at=2022-09-30T09:53:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:32.170959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (55bf0f18-6949-448f-b989-29fef278ddd4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:32.171284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Security group rule updated ['08296d99-906d-4dfc-8732-70e8f5f4be1e'] Sep 30 09:53:32.171941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:32Z,description=,direction='ingress',ethertype='IPv6',id=5c63ff60-0c7c-4555-8fd6-ae211e277e90,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dbda51b7423b4c4980a31fe5f1ecaef3',protocol=,remote_address_group_id=,remote_group_id=08296d99-906d-4dfc-8732-70e8f5f4be1e,remote_ip_prefix=,revision_number=0,security_group_id=08296d99-906d-4dfc-8732-70e8f5f4be1e,updated_at=2022-09-30T09:53:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:32.172290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5c63ff60-0c7c-4555-8fd6-ae211e277e90), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:32.172613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Security group rule updated ['08296d99-906d-4dfc-8732-70e8f5f4be1e'] Sep 30 09:53:32.173262 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:32Z,description=,direction='egress',ethertype='IPv6',id=86e9684f-7b09-49c6-8509-da82119368e0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='dbda51b7423b4c4980a31fe5f1ecaef3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=08296d99-906d-4dfc-8732-70e8f5f4be1e,updated_at=2022-09-30T09:53:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:32.173613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (86e9684f-7b09-49c6-8509-da82119368e0), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:32.174437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Security group rule updated ['08296d99-906d-4dfc-8732-70e8f5f4be1e'] Sep 30 09:53:32.352493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:53:32Z,description='',dns_domain=None,id=4fd2a20a-c3a5-4d96-ac5b-c1db5e16ae31,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-2063031698-network',project_id='dbda51b7423b4c4980a31fe5f1ecaef3',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(4fd2a20a-c3a5-4d96-ac5b-c1db5e16ae31),segments=[NetworkSegment(51ffb5d2-a498-4167-a701-6777281f8a33)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:53:32Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:32.352920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (4fd2a20a-c3a5-4d96-ac5b-c1db5e16ae31), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:32.423606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-8f83326f-1882-4ad5-b0bf-45508331f89a admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 4fd2a20a-c3a5-4d96-ac5b-c1db5e16ae31 with segmentation id not found. Sep 30 09:53:32.423606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:53:32.423606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:53:32.423606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:53:32.423606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:53:32.423606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:53:32.423606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:53:32.423606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:53:32.423606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:53:32.423606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:53:32.423606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:53:32.423606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:53:32.423606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:53:32.426084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:53:32.426084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:53:32.426084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:53:32.426084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 4fd2a20a-c3a5-4d96-ac5b-c1db5e16ae31 with segmentation id not found. Sep 30 09:53:32.426084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:53:32.506053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:479 started Sep 30 09:53:32.508612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=8000000,duration_sec=971,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:32.509219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:32.509573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:479 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:32.822207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-394de2a1-d36d-40c5-8517-6c40388475f1 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(ecc133c0-4294-4301-87c3-68b191864ab6)],cidr=172.20.0.0/28,created_at=2022-09-30T09:53:32Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=0ffd353e-3c29-4695-91e6-98e534f99e08,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-2063031698-subnet',network_id=4fd2a20a-c3a5-4d96-ac5b-c1db5e16ae31,project_id='dbda51b7423b4c4980a31fe5f1ecaef3',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:53:32Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:32.822780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-394de2a1-d36d-40c5-8517-6c40388475f1 admin admin] Publish callbacks [] for Subnet (0ffd353e-3c29-4695-91e6-98e534f99e08), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:34.107666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:53:33Z,description='Default security group',id=a85ca358-a67d-47c9-bf72-8e7ebc4b45a8,is_default=True,name='default',project_id='5b550ae5406f4a87ac453fc2456c2c83',revision_number=1,rules=[SecurityGroupRule(67b0e277-ccc8-4b31-a502-8406891aee37),SecurityGroupRule(a1929d8a-7e5b-4cc1-b49d-77884a709626),SecurityGroupRule(b0ff82c4-6113-4c70-9047-104585e82749),SecurityGroupRule(e47694be-e745-42e1-97e3-cbb454cce3c3)],shared=False,stateful=True,updated_at=2022-09-30T09:53:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:34.108267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (a85ca358-a67d-47c9-bf72-8e7ebc4b45a8), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:34.109131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:33Z,description=,direction='ingress',ethertype='IPv6',id=67b0e277-ccc8-4b31-a502-8406891aee37,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5b550ae5406f4a87ac453fc2456c2c83',protocol=,remote_address_group_id=,remote_group_id=a85ca358-a67d-47c9-bf72-8e7ebc4b45a8,remote_ip_prefix=,revision_number=0,security_group_id=a85ca358-a67d-47c9-bf72-8e7ebc4b45a8,updated_at=2022-09-30T09:53:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:34.109698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (67b0e277-ccc8-4b31-a502-8406891aee37), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:34.110141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Security group rule updated ['a85ca358-a67d-47c9-bf72-8e7ebc4b45a8'] Sep 30 09:53:34.110916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:33Z,description=,direction='ingress',ethertype='IPv4',id=a1929d8a-7e5b-4cc1-b49d-77884a709626,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5b550ae5406f4a87ac453fc2456c2c83',protocol=,remote_address_group_id=,remote_group_id=a85ca358-a67d-47c9-bf72-8e7ebc4b45a8,remote_ip_prefix=,revision_number=0,security_group_id=a85ca358-a67d-47c9-bf72-8e7ebc4b45a8,updated_at=2022-09-30T09:53:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:34.111938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a1929d8a-7e5b-4cc1-b49d-77884a709626), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:34.112351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Security group rule updated ['a85ca358-a67d-47c9-bf72-8e7ebc4b45a8'] Sep 30 09:53:34.113109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:33Z,description=,direction='egress',ethertype='IPv6',id=b0ff82c4-6113-4c70-9047-104585e82749,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5b550ae5406f4a87ac453fc2456c2c83',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a85ca358-a67d-47c9-bf72-8e7ebc4b45a8,updated_at=2022-09-30T09:53:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:34.113614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b0ff82c4-6113-4c70-9047-104585e82749), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:34.114056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Security group rule updated ['a85ca358-a67d-47c9-bf72-8e7ebc4b45a8'] Sep 30 09:53:34.114903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:33Z,description=,direction='egress',ethertype='IPv4',id=e47694be-e745-42e1-97e3-cbb454cce3c3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='5b550ae5406f4a87ac453fc2456c2c83',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a85ca358-a67d-47c9-bf72-8e7ebc4b45a8,updated_at=2022-09-30T09:53:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:34.115255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e47694be-e745-42e1-97e3-cbb454cce3c3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:34.115577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Security group rule updated ['a85ca358-a67d-47c9-bf72-8e7ebc4b45a8'] Sep 30 09:53:34.304848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:53:34Z,description='',dns_domain=None,id=323c2ea7-0d23-4467-a6fb-1e3d215170fe,mtu=1500,name='tempest-EncryptedVolumesExtendAttachedTest-1594410307-network',project_id='5b550ae5406f4a87ac453fc2456c2c83',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(323c2ea7-0d23-4467-a6fb-1e3d215170fe),segments=[NetworkSegment(2c563e08-1c53-4695-ad36-54e773d24613)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:53:34Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:34.305268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (323c2ea7-0d23-4467-a6fb-1e3d215170fe), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:34.375872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-0c7e45b9-8fb1-46c1-9a13-33c0c78c59e4 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 323c2ea7-0d23-4467-a6fb-1e3d215170fe with segmentation id not found. Sep 30 09:53:34.375872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:53:34.375872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:53:34.375872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:53:34.375872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:53:34.375872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:53:34.375872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:53:34.375872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:53:34.375872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:53:34.375872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:53:34.375872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:53:34.375872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:53:34.375872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:53:34.376886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:53:34.376886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:53:34.376886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:53:34.376886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 323c2ea7-0d23-4467-a6fb-1e3d215170fe with segmentation id not found. Sep 30 09:53:34.376886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:53:34.506743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:480 started Sep 30 09:53:34.509137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=9000000,duration_sec=973,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:34.509924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:34.510269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:480 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:34.714344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0f2e7f10-b455-42fd-bc43-eb4f805416d4 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(0f29c5bd-7216-4293-92e8-d920ad6e6472)],cidr=172.20.0.0/28,created_at=2022-09-30T09:53:34Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=ad60d85d-642d-4313-af23-1c961fa9b0cb,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-EncryptedVolumesExtendAttachedTest-1594410307-subnet',network_id=323c2ea7-0d23-4467-a6fb-1e3d215170fe,project_id='5b550ae5406f4a87ac453fc2456c2c83',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:53:34Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:34.714846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0f2e7f10-b455-42fd-bc43-eb4f805416d4 admin admin] Publish callbacks [] for Subnet (ad60d85d-642d-4313-af23-1c961fa9b0cb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:35.438464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-df285d8f-c228-47eb-bbea-62914b0b5600 admin admin] Resource Subnet deleted: 0ffd353e-3c29-4695-91e6-98e534f99e08 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:35.439104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-df285d8f-c228-47eb-bbea-62914b0b5600 admin admin] Publish callbacks [] for Subnet (0ffd353e-3c29-4695-91e6-98e534f99e08), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:35.491635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 869788d7-cd2f-4701-b6bd-a6f79a97b732 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:53:35.492001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (869788d7-cd2f-4701-b6bd-a6f79a97b732), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:35.856602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-501825fe-0d5f-4df0-a784-3652b706c26d admin admin] Resource Network deleted: 4fd2a20a-c3a5-4d96-ac5b-c1db5e16ae31 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:35.856602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-501825fe-0d5f-4df0-a784-3652b706c26d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (4fd2a20a-c3a5-4d96-ac5b-c1db5e16ae31), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:36.121560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d9cd6efd-2de7-40eb-b7f4-2fdd34a87352 admin admin] Resource Subnet deleted: ad60d85d-642d-4313-af23-1c961fa9b0cb {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:36.124963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d9cd6efd-2de7-40eb-b7f4-2fdd34a87352 admin admin] Publish callbacks [] for Subnet (ad60d85d-642d-4313-af23-1c961fa9b0cb), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:36.507211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:481 started Sep 30 09:53:36.510776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=10000000,duration_sec=975,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:36.513685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:36.513685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:481 - starting polling. Elapsed:0.005 Sep 30 09:53:36.517580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:36.521365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:481 - port information retrieved. Elapsed:0.014 Sep 30 09:53:36.522182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:481 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.015 Sep 30 09:53:36.591838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-00dea221-a360-4d0c-8945-83f80aeb71f2 admin admin] Resource Network deleted: 323c2ea7-0d23-4467-a6fb-1e3d215170fe {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:36.592447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-00dea221-a360-4d0c-8945-83f80aeb71f2 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (323c2ea7-0d23-4467-a6fb-1e3d215170fe), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:37.294426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Resource SecurityGroup deleted: 08296d99-906d-4dfc-8732-70e8f5f4be1e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:37.294850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (08296d99-906d-4dfc-8732-70e8f5f4be1e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:37.295874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('08296d99-906d-4dfc-8732-70e8f5f4be1e',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:53:37.312482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('08296d99-906d-4dfc-8732-70e8f5f4be1e',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:53:37.312715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Resource SecurityGroupRule deleted: 04814acd-4e2a-4945-acef-400e5f4f4986 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:37.313006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (04814acd-4e2a-4945-acef-400e5f4f4986), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:37.313439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Security group rule updated ['08296d99-906d-4dfc-8732-70e8f5f4be1e'] Sep 30 09:53:37.314116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Resource SecurityGroupRule deleted: 55bf0f18-6949-448f-b989-29fef278ddd4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:37.314850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (55bf0f18-6949-448f-b989-29fef278ddd4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:37.315261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Security group rule updated ['08296d99-906d-4dfc-8732-70e8f5f4be1e'] Sep 30 09:53:37.315839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Resource SecurityGroupRule deleted: 5c63ff60-0c7c-4555-8fd6-ae211e277e90 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:37.316542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5c63ff60-0c7c-4555-8fd6-ae211e277e90), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:37.316984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Security group rule updated ['08296d99-906d-4dfc-8732-70e8f5f4be1e'] Sep 30 09:53:37.317586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Resource SecurityGroupRule deleted: 86e9684f-7b09-49c6-8509-da82119368e0 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:37.318434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (86e9684f-7b09-49c6-8509-da82119368e0), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:37.318855 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-eaf2e6f0-c004-4c93-87c3-20d9f96348e1 admin admin] Security group rule updated ['08296d99-906d-4dfc-8732-70e8f5f4be1e'] Sep 30 09:53:37.396516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 869788d7-cd2f-4701-b6bd-a6f79a97b732 updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:53:37.396972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (869788d7-cd2f-4701-b6bd-a6f79a97b732), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:38.320570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Resource SecurityGroup deleted: a85ca358-a67d-47c9-bf72-8e7ebc4b45a8 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:38.322546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (a85ca358-a67d-47c9-bf72-8e7ebc4b45a8), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:38.323160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a85ca358-a67d-47c9-bf72-8e7ebc4b45a8',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:53:38.338443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a85ca358-a67d-47c9-bf72-8e7ebc4b45a8',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:53:38.339123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Resource SecurityGroupRule deleted: 67b0e277-ccc8-4b31-a502-8406891aee37 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:38.339378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (67b0e277-ccc8-4b31-a502-8406891aee37), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:38.339713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Security group rule updated ['a85ca358-a67d-47c9-bf72-8e7ebc4b45a8'] Sep 30 09:53:38.340100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Resource SecurityGroupRule deleted: a1929d8a-7e5b-4cc1-b49d-77884a709626 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:38.340539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a1929d8a-7e5b-4cc1-b49d-77884a709626), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:38.340761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Security group rule updated ['a85ca358-a67d-47c9-bf72-8e7ebc4b45a8'] Sep 30 09:53:38.341125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Resource SecurityGroupRule deleted: b0ff82c4-6113-4c70-9047-104585e82749 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:38.341465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b0ff82c4-6113-4c70-9047-104585e82749), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:38.341777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Security group rule updated ['a85ca358-a67d-47c9-bf72-8e7ebc4b45a8'] Sep 30 09:53:38.342134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Resource SecurityGroupRule deleted: e47694be-e745-42e1-97e3-cbb454cce3c3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:38.344659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e47694be-e745-42e1-97e3-cbb454cce3c3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:38.347657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-28569683-9afc-4c20-a454-3f6d2fcdb6fe admin admin] Security group rule updated ['a85ca358-a67d-47c9-bf72-8e7ebc4b45a8'] Sep 30 09:53:38.508748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:482 started Sep 30 09:53:38.511618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=11000000,duration_sec=977,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:38.512275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:38.512995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:482 - starting polling. Elapsed:0.004 Sep 30 09:53:38.516165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:38.520307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:482 - port information retrieved. Elapsed:0.012 Sep 30 09:53:38.520653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:482 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 30 09:53:40.509700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:483 started Sep 30 09:53:40.513241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=13000000,duration_sec=979,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:40.514121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:40.514704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:483 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:53:42.510645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:484 started Sep 30 09:53:42.513275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=13000000,duration_sec=981,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:42.513942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:42.514353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:484 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:44.511141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:485 started Sep 30 09:53:44.513735 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=14000000,duration_sec=983,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:44.514387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:44.514865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:485 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:46.511821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:486 started Sep 30 09:53:46.515383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=15000000,duration_sec=985,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:46.516487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:46.516657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:486 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:53:46.928611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:53:46Z,description='Default security group',id=1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7,is_default=True,name='default',project_id='cd57b0eceece4299b37d3aef570cb197',revision_number=1,rules=[SecurityGroupRule(69042f5a-c554-44c1-9201-288e735ec0d9),SecurityGroupRule(a1d23756-d630-4968-8c53-eb94f1a95ea7),SecurityGroupRule(d1f9fc4e-ca52-4897-9b95-8b620711fea3),SecurityGroupRule(d4f65946-8836-4c3c-b4a8-5034ee24ffc1)],shared=False,stateful=True,updated_at=2022-09-30T09:53:46Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:46.930908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:46.930908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:46Z,description=,direction='ingress',ethertype='IPv6',id=69042f5a-c554-44c1-9201-288e735ec0d9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd57b0eceece4299b37d3aef570cb197',protocol=,remote_address_group_id=,remote_group_id=1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7,remote_ip_prefix=,revision_number=0,security_group_id=1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7,updated_at=2022-09-30T09:53:46Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:46.930908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (69042f5a-c554-44c1-9201-288e735ec0d9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:46.930908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Security group rule updated ['1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7'] Sep 30 09:53:46.931356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:46Z,description=,direction='egress',ethertype='IPv6',id=a1d23756-d630-4968-8c53-eb94f1a95ea7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd57b0eceece4299b37d3aef570cb197',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7,updated_at=2022-09-30T09:53:46Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:46.931356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a1d23756-d630-4968-8c53-eb94f1a95ea7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:46.931625 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Security group rule updated ['1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7'] Sep 30 09:53:46.932293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:46Z,description=,direction='ingress',ethertype='IPv4',id=d1f9fc4e-ca52-4897-9b95-8b620711fea3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd57b0eceece4299b37d3aef570cb197',protocol=,remote_address_group_id=,remote_group_id=1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7,remote_ip_prefix=,revision_number=0,security_group_id=1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7,updated_at=2022-09-30T09:53:46Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:46.932664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d1f9fc4e-ca52-4897-9b95-8b620711fea3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:46.933011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Security group rule updated ['1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7'] Sep 30 09:53:46.933651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:46Z,description=,direction='egress',ethertype='IPv4',id=d4f65946-8836-4c3c-b4a8-5034ee24ffc1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='cd57b0eceece4299b37d3aef570cb197',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7,updated_at=2022-09-30T09:53:46Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:46.933993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d4f65946-8836-4c3c-b4a8-5034ee24ffc1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:46.934310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1ebdf6c3-c5eb-472c-bcf4-73c3bc9ccd92 admin admin] Security group rule updated ['1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7'] Sep 30 09:53:47.120800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Resource SecurityGroup deleted: 1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:47.121324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:47.121850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:53:47.135357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:53:47.135985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Resource SecurityGroupRule deleted: 69042f5a-c554-44c1-9201-288e735ec0d9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:47.136348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (69042f5a-c554-44c1-9201-288e735ec0d9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:47.136723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Security group rule updated ['1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7'] Sep 30 09:53:47.137139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Resource SecurityGroupRule deleted: a1d23756-d630-4968-8c53-eb94f1a95ea7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:47.137480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a1d23756-d630-4968-8c53-eb94f1a95ea7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:47.137791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Security group rule updated ['1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7'] Sep 30 09:53:47.138225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Resource SecurityGroupRule deleted: d1f9fc4e-ca52-4897-9b95-8b620711fea3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:47.138565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d1f9fc4e-ca52-4897-9b95-8b620711fea3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:47.139158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Security group rule updated ['1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7'] Sep 30 09:53:47.139314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Resource SecurityGroupRule deleted: d4f65946-8836-4c3c-b4a8-5034ee24ffc1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:47.139576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d4f65946-8836-4c3c-b4a8-5034ee24ffc1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:47.139992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-afc4755e-c47d-47d0-a6d3-0ba2302d80d9 admin admin] Security group rule updated ['1765f81a-f9fb-4bcb-85a5-6bde51a0b4b7'] Sep 30 09:53:47.985769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:53:47Z,description='Default security group',id=0cea6222-627b-4a30-ae8b-dcfbc77b5394,is_default=True,name='default',project_id='b08fcad561da4e5e9c6de182db49f9cc',revision_number=1,rules=[SecurityGroupRule(6904072d-b378-4818-9b9f-af4a6b57c569),SecurityGroupRule(c193a5bf-da99-4e2b-83d3-282e3c1a4dc1),SecurityGroupRule(eacb0083-2024-4415-b345-6ea55bf91d8c),SecurityGroupRule(ec3a7c93-ee8e-4145-81c8-11f21ea7c48c)],shared=False,stateful=True,updated_at=2022-09-30T09:53:47Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:47.989721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (0cea6222-627b-4a30-ae8b-dcfbc77b5394), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:47.989721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:47Z,description=,direction='ingress',ethertype='IPv6',id=6904072d-b378-4818-9b9f-af4a6b57c569,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b08fcad561da4e5e9c6de182db49f9cc',protocol=,remote_address_group_id=,remote_group_id=0cea6222-627b-4a30-ae8b-dcfbc77b5394,remote_ip_prefix=,revision_number=0,security_group_id=0cea6222-627b-4a30-ae8b-dcfbc77b5394,updated_at=2022-09-30T09:53:47Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:47.989721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (6904072d-b378-4818-9b9f-af4a6b57c569), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:47.989721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Security group rule updated ['0cea6222-627b-4a30-ae8b-dcfbc77b5394'] Sep 30 09:53:47.990109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:47Z,description=,direction='egress',ethertype='IPv4',id=c193a5bf-da99-4e2b-83d3-282e3c1a4dc1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b08fcad561da4e5e9c6de182db49f9cc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0cea6222-627b-4a30-ae8b-dcfbc77b5394,updated_at=2022-09-30T09:53:47Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:47.990109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c193a5bf-da99-4e2b-83d3-282e3c1a4dc1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:47.990109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Security group rule updated ['0cea6222-627b-4a30-ae8b-dcfbc77b5394'] Sep 30 09:53:47.990358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:47Z,description=,direction='egress',ethertype='IPv6',id=eacb0083-2024-4415-b345-6ea55bf91d8c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b08fcad561da4e5e9c6de182db49f9cc',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0cea6222-627b-4a30-ae8b-dcfbc77b5394,updated_at=2022-09-30T09:53:47Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:47.991026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (eacb0083-2024-4415-b345-6ea55bf91d8c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:47.991547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Security group rule updated ['0cea6222-627b-4a30-ae8b-dcfbc77b5394'] Sep 30 09:53:47.992221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:47Z,description=,direction='ingress',ethertype='IPv4',id=ec3a7c93-ee8e-4145-81c8-11f21ea7c48c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b08fcad561da4e5e9c6de182db49f9cc',protocol=,remote_address_group_id=,remote_group_id=0cea6222-627b-4a30-ae8b-dcfbc77b5394,remote_ip_prefix=,revision_number=0,security_group_id=0cea6222-627b-4a30-ae8b-dcfbc77b5394,updated_at=2022-09-30T09:53:47Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:47.992576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (ec3a7c93-ee8e-4145-81c8-11f21ea7c48c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:47.992900 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-28c55bd2-2858-4d45-9385-20fb3e537c7c admin admin] Security group rule updated ['0cea6222-627b-4a30-ae8b-dcfbc77b5394'] Sep 30 09:53:48.164601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Resource SecurityGroup deleted: 0cea6222-627b-4a30-ae8b-dcfbc77b5394 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:48.165189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (0cea6222-627b-4a30-ae8b-dcfbc77b5394), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:48.165715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0cea6222-627b-4a30-ae8b-dcfbc77b5394',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:53:48.182166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0cea6222-627b-4a30-ae8b-dcfbc77b5394',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:53:48.182709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Resource SecurityGroupRule deleted: 6904072d-b378-4818-9b9f-af4a6b57c569 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:48.183075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (6904072d-b378-4818-9b9f-af4a6b57c569), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:48.183401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Security group rule updated ['0cea6222-627b-4a30-ae8b-dcfbc77b5394'] Sep 30 09:53:48.184118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Resource SecurityGroupRule deleted: c193a5bf-da99-4e2b-83d3-282e3c1a4dc1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:48.184118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c193a5bf-da99-4e2b-83d3-282e3c1a4dc1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:48.184410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Security group rule updated ['0cea6222-627b-4a30-ae8b-dcfbc77b5394'] Sep 30 09:53:48.184768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Resource SecurityGroupRule deleted: eacb0083-2024-4415-b345-6ea55bf91d8c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:48.185104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (eacb0083-2024-4415-b345-6ea55bf91d8c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:48.185572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Security group rule updated ['0cea6222-627b-4a30-ae8b-dcfbc77b5394'] Sep 30 09:53:48.185936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Resource SecurityGroupRule deleted: ec3a7c93-ee8e-4145-81c8-11f21ea7c48c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:48.186273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (ec3a7c93-ee8e-4145-81c8-11f21ea7c48c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:48.186576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-aef3f0e2-65cb-4ee5-a9e0-50f9b5dfdf14 admin admin] Security group rule updated ['0cea6222-627b-4a30-ae8b-dcfbc77b5394'] Sep 30 09:53:48.512930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:487 started Sep 30 09:53:48.515902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=16000000,duration_sec=987,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:48.516893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:48.517246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:487 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:53:50.513579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:488 started Sep 30 09:53:50.516064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05da,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=16000000,duration_sec=989,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:50.516666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:50.517011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:488 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:51.434867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 869788d7-cd2f-4701-b6bd-a6f79a97b732 updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:53:51.435246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (869788d7-cd2f-4701-b6bd-a6f79a97b732), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:52.514296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:489 started Sep 30 09:53:52.516799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=17000000,duration_sec=991,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:52.518011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:52.518720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:489 - starting polling. Elapsed:0.005 Sep 30 09:53:52.521987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:52.525475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:489 - port information retrieved. Elapsed:0.011 Sep 30 09:53:52.526018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:489 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 30 09:53:54.515108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:490 started Sep 30 09:53:54.518097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05de,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=17000000,duration_sec=993,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:54.518720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:54.519087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:490 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:55.667567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:53:55Z,description='Default security group',id=fff22fd8-46e8-4612-8e56-581c4d2820b6,is_default=True,name='default',project_id='91d9d6efb39a4cb1b8d708fb2f20c580',revision_number=1,rules=[SecurityGroupRule(32c36eb8-92d1-4c84-b83c-9b57bb149867),SecurityGroupRule(80e99d16-a213-4861-940e-54df170f8277),SecurityGroupRule(b4bed683-587d-4614-a8e6-23d401cab8a0),SecurityGroupRule(debe4f3f-71b7-4ca1-b60e-3278cd9a7bed)],shared=False,stateful=True,updated_at=2022-09-30T09:53:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:55.668209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (fff22fd8-46e8-4612-8e56-581c4d2820b6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:55.679119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:55Z,description=,direction='egress',ethertype='IPv4',id=32c36eb8-92d1-4c84-b83c-9b57bb149867,normalized_cidr=None,port_range_max=,port_range_min=,project_id='91d9d6efb39a4cb1b8d708fb2f20c580',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fff22fd8-46e8-4612-8e56-581c4d2820b6,updated_at=2022-09-30T09:53:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:55.679119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (32c36eb8-92d1-4c84-b83c-9b57bb149867), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:55.679119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Security group rule updated ['fff22fd8-46e8-4612-8e56-581c4d2820b6'] Sep 30 09:53:55.679610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:55Z,description=,direction='ingress',ethertype='IPv4',id=80e99d16-a213-4861-940e-54df170f8277,normalized_cidr=None,port_range_max=,port_range_min=,project_id='91d9d6efb39a4cb1b8d708fb2f20c580',protocol=,remote_address_group_id=,remote_group_id=fff22fd8-46e8-4612-8e56-581c4d2820b6,remote_ip_prefix=,revision_number=0,security_group_id=fff22fd8-46e8-4612-8e56-581c4d2820b6,updated_at=2022-09-30T09:53:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:55.679610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (80e99d16-a213-4861-940e-54df170f8277), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:55.679610 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Security group rule updated ['fff22fd8-46e8-4612-8e56-581c4d2820b6'] Sep 30 09:53:55.679916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:55Z,description=,direction='egress',ethertype='IPv6',id=b4bed683-587d-4614-a8e6-23d401cab8a0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='91d9d6efb39a4cb1b8d708fb2f20c580',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=fff22fd8-46e8-4612-8e56-581c4d2820b6,updated_at=2022-09-30T09:53:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:55.679916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b4bed683-587d-4614-a8e6-23d401cab8a0), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:55.679916 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Security group rule updated ['fff22fd8-46e8-4612-8e56-581c4d2820b6'] Sep 30 09:53:55.680166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:55Z,description=,direction='ingress',ethertype='IPv6',id=debe4f3f-71b7-4ca1-b60e-3278cd9a7bed,normalized_cidr=None,port_range_max=,port_range_min=,project_id='91d9d6efb39a4cb1b8d708fb2f20c580',protocol=,remote_address_group_id=,remote_group_id=fff22fd8-46e8-4612-8e56-581c4d2820b6,remote_ip_prefix=,revision_number=0,security_group_id=fff22fd8-46e8-4612-8e56-581c4d2820b6,updated_at=2022-09-30T09:53:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:55.680166 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (debe4f3f-71b7-4ca1-b60e-3278cd9a7bed), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:55.680363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-6356b818-b1a0-4d71-8340-eae69e70a2db admin admin] Security group rule updated ['fff22fd8-46e8-4612-8e56-581c4d2820b6'] Sep 30 09:53:55.889501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Resource SecurityGroup deleted: fff22fd8-46e8-4612-8e56-581c4d2820b6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:55.889875 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (fff22fd8-46e8-4612-8e56-581c4d2820b6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:55.890356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fff22fd8-46e8-4612-8e56-581c4d2820b6',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:53:55.908137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fff22fd8-46e8-4612-8e56-581c4d2820b6',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:53:55.908630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Resource SecurityGroupRule deleted: 32c36eb8-92d1-4c84-b83c-9b57bb149867 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:55.909156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (32c36eb8-92d1-4c84-b83c-9b57bb149867), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:55.910524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Security group rule updated ['fff22fd8-46e8-4612-8e56-581c4d2820b6'] Sep 30 09:53:55.911022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Resource SecurityGroupRule deleted: 80e99d16-a213-4861-940e-54df170f8277 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:55.911376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (80e99d16-a213-4861-940e-54df170f8277), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:55.911695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Security group rule updated ['fff22fd8-46e8-4612-8e56-581c4d2820b6'] Sep 30 09:53:55.912064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Resource SecurityGroupRule deleted: b4bed683-587d-4614-a8e6-23d401cab8a0 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:55.912411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b4bed683-587d-4614-a8e6-23d401cab8a0), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:55.912742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Security group rule updated ['fff22fd8-46e8-4612-8e56-581c4d2820b6'] Sep 30 09:53:55.913269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Resource SecurityGroupRule deleted: debe4f3f-71b7-4ca1-b60e-3278cd9a7bed {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:55.913602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (debe4f3f-71b7-4ca1-b60e-3278cd9a7bed), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:55.913939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-43465da3-b005-404c-a64c-2cd200e8f3ac admin admin] Security group rule updated ['fff22fd8-46e8-4612-8e56-581c4d2820b6'] Sep 30 09:53:56.516343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:491 started Sep 30 09:53:56.519012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05e0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=19000000,duration_sec=995,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:56.519702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:56.520169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:491 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:53:56.710987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:53:56Z,description='Default security group',id=89089a69-64aa-4bd3-9816-7ac03bb3b695,is_default=True,name='default',project_id='65d7401752b34e23ae3c1960e68c3922',revision_number=1,rules=[SecurityGroupRule(29442ad5-80b0-47cf-a870-8e08aa04bbc6),SecurityGroupRule(75f21b9c-d0ed-45ec-9cc4-7781e50849ce),SecurityGroupRule(a6b33838-da04-4a2f-b8d1-abbd11af4f08),SecurityGroupRule(a8a2ba56-6a4e-4155-a0b7-0693ae100a4b)],shared=False,stateful=True,updated_at=2022-09-30T09:53:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:56.711641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (89089a69-64aa-4bd3-9816-7ac03bb3b695), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:56.712155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:56Z,description=,direction='ingress',ethertype='IPv6',id=29442ad5-80b0-47cf-a870-8e08aa04bbc6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='65d7401752b34e23ae3c1960e68c3922',protocol=,remote_address_group_id=,remote_group_id=89089a69-64aa-4bd3-9816-7ac03bb3b695,remote_ip_prefix=,revision_number=0,security_group_id=89089a69-64aa-4bd3-9816-7ac03bb3b695,updated_at=2022-09-30T09:53:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:56.712695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (29442ad5-80b0-47cf-a870-8e08aa04bbc6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:56.713060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Security group rule updated ['89089a69-64aa-4bd3-9816-7ac03bb3b695'] Sep 30 09:53:56.713812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:56Z,description=,direction='egress',ethertype='IPv6',id=75f21b9c-d0ed-45ec-9cc4-7781e50849ce,normalized_cidr=None,port_range_max=,port_range_min=,project_id='65d7401752b34e23ae3c1960e68c3922',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=89089a69-64aa-4bd3-9816-7ac03bb3b695,updated_at=2022-09-30T09:53:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:56.714240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (75f21b9c-d0ed-45ec-9cc4-7781e50849ce), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:56.714669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Security group rule updated ['89089a69-64aa-4bd3-9816-7ac03bb3b695'] Sep 30 09:53:56.715414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:56Z,description=,direction='ingress',ethertype='IPv4',id=a6b33838-da04-4a2f-b8d1-abbd11af4f08,normalized_cidr=None,port_range_max=,port_range_min=,project_id='65d7401752b34e23ae3c1960e68c3922',protocol=,remote_address_group_id=,remote_group_id=89089a69-64aa-4bd3-9816-7ac03bb3b695,remote_ip_prefix=,revision_number=0,security_group_id=89089a69-64aa-4bd3-9816-7ac03bb3b695,updated_at=2022-09-30T09:53:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:56.715870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a6b33838-da04-4a2f-b8d1-abbd11af4f08), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:56.716282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Security group rule updated ['89089a69-64aa-4bd3-9816-7ac03bb3b695'] Sep 30 09:53:56.717010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:56Z,description=,direction='egress',ethertype='IPv4',id=a8a2ba56-6a4e-4155-a0b7-0693ae100a4b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='65d7401752b34e23ae3c1960e68c3922',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=89089a69-64aa-4bd3-9816-7ac03bb3b695,updated_at=2022-09-30T09:53:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:56.717580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (a8a2ba56-6a4e-4155-a0b7-0693ae100a4b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:56.717976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dd6ea3c1-df87-4118-8912-f8df46825abb admin admin] Security group rule updated ['89089a69-64aa-4bd3-9816-7ac03bb3b695'] Sep 30 09:53:56.937013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Resource SecurityGroup deleted: 89089a69-64aa-4bd3-9816-7ac03bb3b695 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:56.937459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (89089a69-64aa-4bd3-9816-7ac03bb3b695), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:56.937985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('89089a69-64aa-4bd3-9816-7ac03bb3b695',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:53:56.953897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('89089a69-64aa-4bd3-9816-7ac03bb3b695',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:53:56.954401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Resource SecurityGroupRule deleted: 29442ad5-80b0-47cf-a870-8e08aa04bbc6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:56.954806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (29442ad5-80b0-47cf-a870-8e08aa04bbc6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:56.955629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Security group rule updated ['89089a69-64aa-4bd3-9816-7ac03bb3b695'] Sep 30 09:53:56.956017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Resource SecurityGroupRule deleted: 75f21b9c-d0ed-45ec-9cc4-7781e50849ce {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:56.956364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (75f21b9c-d0ed-45ec-9cc4-7781e50849ce), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:56.956680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Security group rule updated ['89089a69-64aa-4bd3-9816-7ac03bb3b695'] Sep 30 09:53:56.957052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Resource SecurityGroupRule deleted: a6b33838-da04-4a2f-b8d1-abbd11af4f08 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:56.957391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a6b33838-da04-4a2f-b8d1-abbd11af4f08), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:56.957701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Security group rule updated ['89089a69-64aa-4bd3-9816-7ac03bb3b695'] Sep 30 09:53:56.958234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Resource SecurityGroupRule deleted: a8a2ba56-6a4e-4155-a0b7-0693ae100a4b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:56.958574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a8a2ba56-6a4e-4155-a0b7-0693ae100a4b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:56.958914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-edee839f-d6ac-4d20-8860-cce534be6fad admin admin] Security group rule updated ['89089a69-64aa-4bd3-9816-7ac03bb3b695'] Sep 30 09:53:57.947961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:53:57Z,description='Default security group',id=f2b5538b-898f-44d3-ad6e-63b2e83b9ab1,is_default=True,name='default',project_id='e884368231434621add5dc2b643fae9c',revision_number=1,rules=[SecurityGroupRule(4edc8cd3-05e7-4f13-921a-07d2596f4ff5),SecurityGroupRule(4f3909c7-8a37-4a1c-b9e1-b0c656d826eb),SecurityGroupRule(5056af23-a043-4ccb-a1bb-81ed21cfe138),SecurityGroupRule(d6954f72-e23e-4ab4-8673-6dee66ae0c28)],shared=False,stateful=True,updated_at=2022-09-30T09:53:57Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:57.947961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (f2b5538b-898f-44d3-ad6e-63b2e83b9ab1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:57.949701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:57Z,description=,direction='ingress',ethertype='IPv4',id=4edc8cd3-05e7-4f13-921a-07d2596f4ff5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e884368231434621add5dc2b643fae9c',protocol=,remote_address_group_id=,remote_group_id=f2b5538b-898f-44d3-ad6e-63b2e83b9ab1,remote_ip_prefix=,revision_number=0,security_group_id=f2b5538b-898f-44d3-ad6e-63b2e83b9ab1,updated_at=2022-09-30T09:53:57Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:57.950082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4edc8cd3-05e7-4f13-921a-07d2596f4ff5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:57.950421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Security group rule updated ['f2b5538b-898f-44d3-ad6e-63b2e83b9ab1'] Sep 30 09:53:57.951164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:57Z,description=,direction='egress',ethertype='IPv4',id=4f3909c7-8a37-4a1c-b9e1-b0c656d826eb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e884368231434621add5dc2b643fae9c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f2b5538b-898f-44d3-ad6e-63b2e83b9ab1,updated_at=2022-09-30T09:53:57Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:57.951821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4f3909c7-8a37-4a1c-b9e1-b0c656d826eb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:57.952335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Security group rule updated ['f2b5538b-898f-44d3-ad6e-63b2e83b9ab1'] Sep 30 09:53:57.953196 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:57Z,description=,direction='ingress',ethertype='IPv6',id=5056af23-a043-4ccb-a1bb-81ed21cfe138,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e884368231434621add5dc2b643fae9c',protocol=,remote_address_group_id=,remote_group_id=f2b5538b-898f-44d3-ad6e-63b2e83b9ab1,remote_ip_prefix=,revision_number=0,security_group_id=f2b5538b-898f-44d3-ad6e-63b2e83b9ab1,updated_at=2022-09-30T09:53:57Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:57.953558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5056af23-a043-4ccb-a1bb-81ed21cfe138), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:57.954008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Security group rule updated ['f2b5538b-898f-44d3-ad6e-63b2e83b9ab1'] Sep 30 09:53:57.954848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:57Z,description=,direction='egress',ethertype='IPv6',id=d6954f72-e23e-4ab4-8673-6dee66ae0c28,normalized_cidr=None,port_range_max=,port_range_min=,project_id='e884368231434621add5dc2b643fae9c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f2b5538b-898f-44d3-ad6e-63b2e83b9ab1,updated_at=2022-09-30T09:53:57Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:57.955431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d6954f72-e23e-4ab4-8673-6dee66ae0c28), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:57.955936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-48c94988-99fa-4ed6-8401-9d8e49f9ceb1 admin admin] Security group rule updated ['f2b5538b-898f-44d3-ad6e-63b2e83b9ab1'] Sep 30 09:53:58.173407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Resource SecurityGroup deleted: f2b5538b-898f-44d3-ad6e-63b2e83b9ab1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:58.174422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (f2b5538b-898f-44d3-ad6e-63b2e83b9ab1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:58.175268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f2b5538b-898f-44d3-ad6e-63b2e83b9ab1',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:53:58.191221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f2b5538b-898f-44d3-ad6e-63b2e83b9ab1',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:53:58.192019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Resource SecurityGroupRule deleted: 4edc8cd3-05e7-4f13-921a-07d2596f4ff5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:58.192668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4edc8cd3-05e7-4f13-921a-07d2596f4ff5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:58.198362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Security group rule updated ['f2b5538b-898f-44d3-ad6e-63b2e83b9ab1'] Sep 30 09:53:58.199077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Resource SecurityGroupRule deleted: 4f3909c7-8a37-4a1c-b9e1-b0c656d826eb {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:58.199595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4f3909c7-8a37-4a1c-b9e1-b0c656d826eb), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:58.200752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Security group rule updated ['f2b5538b-898f-44d3-ad6e-63b2e83b9ab1'] Sep 30 09:53:58.201290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Resource SecurityGroupRule deleted: 5056af23-a043-4ccb-a1bb-81ed21cfe138 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:58.201800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5056af23-a043-4ccb-a1bb-81ed21cfe138), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:58.202292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Security group rule updated ['f2b5538b-898f-44d3-ad6e-63b2e83b9ab1'] Sep 30 09:53:58.202850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Resource SecurityGroupRule deleted: d6954f72-e23e-4ab4-8673-6dee66ae0c28 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:53:58.203348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d6954f72-e23e-4ab4-8673-6dee66ae0c28), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:58.203825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-580741aa-661f-4198-a803-cbf84b9f384a admin admin] Security group rule updated ['f2b5538b-898f-44d3-ad6e-63b2e83b9ab1'] Sep 30 09:53:58.517237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:492 started Sep 30 09:53:58.520756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=21000000,duration_sec=997,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:53:58.521444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:53:58.521901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:492 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:53:59.683257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:53:59Z,description='Default security group',id=ddaf52f4-42a5-4b87-bd61-830bc1dc11fe,is_default=True,name='default',project_id='d64c50fedbf0431f84ad9ac73c3c5506',revision_number=1,rules=[SecurityGroupRule(07b3e9a4-a58c-4a3d-9405-6392283fa33c),SecurityGroupRule(10c652fc-b2dd-46ce-ab83-aa27afb4145a),SecurityGroupRule(90a61c87-3901-4788-86f8-aaf67440dc3d),SecurityGroupRule(ebaa3bb6-55fd-4046-ab9d-1d0368954798)],shared=False,stateful=True,updated_at=2022-09-30T09:53:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:59.684326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (ddaf52f4-42a5-4b87-bd61-830bc1dc11fe), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:59.684987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:59Z,description=,direction='egress',ethertype='IPv4',id=07b3e9a4-a58c-4a3d-9405-6392283fa33c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d64c50fedbf0431f84ad9ac73c3c5506',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ddaf52f4-42a5-4b87-bd61-830bc1dc11fe,updated_at=2022-09-30T09:53:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:59.685355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (07b3e9a4-a58c-4a3d-9405-6392283fa33c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:59.685686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Security group rule updated ['ddaf52f4-42a5-4b87-bd61-830bc1dc11fe'] Sep 30 09:53:59.686522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:59Z,description=,direction='egress',ethertype='IPv6',id=10c652fc-b2dd-46ce-ab83-aa27afb4145a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d64c50fedbf0431f84ad9ac73c3c5506',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=ddaf52f4-42a5-4b87-bd61-830bc1dc11fe,updated_at=2022-09-30T09:53:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:59.686935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (10c652fc-b2dd-46ce-ab83-aa27afb4145a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:59.688371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Security group rule updated ['ddaf52f4-42a5-4b87-bd61-830bc1dc11fe'] Sep 30 09:53:59.689063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:59Z,description=,direction='ingress',ethertype='IPv4',id=90a61c87-3901-4788-86f8-aaf67440dc3d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d64c50fedbf0431f84ad9ac73c3c5506',protocol=,remote_address_group_id=,remote_group_id=ddaf52f4-42a5-4b87-bd61-830bc1dc11fe,remote_ip_prefix=,revision_number=0,security_group_id=ddaf52f4-42a5-4b87-bd61-830bc1dc11fe,updated_at=2022-09-30T09:53:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:59.692336 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (90a61c87-3901-4788-86f8-aaf67440dc3d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:59.692768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Security group rule updated ['ddaf52f4-42a5-4b87-bd61-830bc1dc11fe'] Sep 30 09:53:59.693511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:53:59Z,description=,direction='ingress',ethertype='IPv6',id=ebaa3bb6-55fd-4046-ab9d-1d0368954798,normalized_cidr=None,port_range_max=,port_range_min=,project_id='d64c50fedbf0431f84ad9ac73c3c5506',protocol=,remote_address_group_id=,remote_group_id=ddaf52f4-42a5-4b87-bd61-830bc1dc11fe,remote_ip_prefix=,revision_number=0,security_group_id=ddaf52f4-42a5-4b87-bd61-830bc1dc11fe,updated_at=2022-09-30T09:53:59Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:53:59.693882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (ebaa3bb6-55fd-4046-ab9d-1d0368954798), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:53:59.694221 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Security group rule updated ['ddaf52f4-42a5-4b87-bd61-830bc1dc11fe'] Sep 30 09:54:00.183095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:53:59Z,description='',dns_domain=None,id=5c0f05c7-ec18-4e10-b234-25cee24d83c9,mtu=1500,name='tempest-VolumesActionsTest-1846576578-network',project_id='d64c50fedbf0431f84ad9ac73c3c5506',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(5c0f05c7-ec18-4e10-b234-25cee24d83c9),segments=[NetworkSegment(06f04bf9-2fc8-4159-b3cb-a82cb91fe00c)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:53:59Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:00.185804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (5c0f05c7-ec18-4e10-b234-25cee24d83c9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:00.260802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-dc46c580-ae6f-4b8d-885a-a86ce01a1002 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5c0f05c7-ec18-4e10-b234-25cee24d83c9 with segmentation id not found. Sep 30 09:54:00.260802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:54:00.260802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:54:00.260802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:54:00.260802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:54:00.260802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:54:00.260802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:54:00.260802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:54:00.260802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:54:00.260802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:54:00.260802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:54:00.260802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:54:00.260802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:54:00.261911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:54:00.261911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:54:00.261911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:54:00.261911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5c0f05c7-ec18-4e10-b234-25cee24d83c9 with segmentation id not found. Sep 30 09:54:00.261911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:54:00.518611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:493 started Sep 30 09:54:00.521324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=21000000,duration_sec=999,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:00.522404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:00.522868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:493 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:54:00.705179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-885cf3d8-1a35-4db4-a300-b8dfd1125968 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(55b02faa-1889-42b0-84b7-1c1ef5d011e3)],cidr=172.20.0.0/28,created_at=2022-09-30T09:54:00Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=d2263e17-d5e3-4d55-a22b-94f76cff031b,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-1846576578-subnet',network_id=5c0f05c7-ec18-4e10-b234-25cee24d83c9,project_id='d64c50fedbf0431f84ad9ac73c3c5506',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:54:00Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:00.705867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-885cf3d8-1a35-4db4-a300-b8dfd1125968 admin admin] Publish callbacks [] for Subnet (d2263e17-d5e3-4d55-a22b-94f76cff031b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:02.112574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:54:01Z,description='Default security group',id=79263387-953c-4dca-ad79-82d7ef5dfddb,is_default=True,name='default',project_id='be70ba68d13c4b9bbac7f0d788641990',revision_number=1,rules=[SecurityGroupRule(1870c845-92a0-40c1-878c-a0106c0d1d20),SecurityGroupRule(4925506b-4ab6-484f-ba4a-dd623f61342b),SecurityGroupRule(80e2e968-d0be-4282-907d-b90425e991b8),SecurityGroupRule(9cdf3ab0-0ec9-4b6b-9456-2431ca4aa334)],shared=False,stateful=True,updated_at=2022-09-30T09:54:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:02.114021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (79263387-953c-4dca-ad79-82d7ef5dfddb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:02.114937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:01Z,description=,direction='ingress',ethertype='IPv4',id=1870c845-92a0-40c1-878c-a0106c0d1d20,normalized_cidr=None,port_range_max=,port_range_min=,project_id='be70ba68d13c4b9bbac7f0d788641990',protocol=,remote_address_group_id=,remote_group_id=79263387-953c-4dca-ad79-82d7ef5dfddb,remote_ip_prefix=,revision_number=0,security_group_id=79263387-953c-4dca-ad79-82d7ef5dfddb,updated_at=2022-09-30T09:54:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:02.115493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (1870c845-92a0-40c1-878c-a0106c0d1d20), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:02.115986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Security group rule updated ['79263387-953c-4dca-ad79-82d7ef5dfddb'] Sep 30 09:54:02.116926 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:01Z,description=,direction='egress',ethertype='IPv6',id=4925506b-4ab6-484f-ba4a-dd623f61342b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='be70ba68d13c4b9bbac7f0d788641990',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=79263387-953c-4dca-ad79-82d7ef5dfddb,updated_at=2022-09-30T09:54:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:02.117542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4925506b-4ab6-484f-ba4a-dd623f61342b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:02.118037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Security group rule updated ['79263387-953c-4dca-ad79-82d7ef5dfddb'] Sep 30 09:54:02.118974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:01Z,description=,direction='egress',ethertype='IPv4',id=80e2e968-d0be-4282-907d-b90425e991b8,normalized_cidr=None,port_range_max=,port_range_min=,project_id='be70ba68d13c4b9bbac7f0d788641990',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=79263387-953c-4dca-ad79-82d7ef5dfddb,updated_at=2022-09-30T09:54:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:02.120348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (80e2e968-d0be-4282-907d-b90425e991b8), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:02.121477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Security group rule updated ['79263387-953c-4dca-ad79-82d7ef5dfddb'] Sep 30 09:54:02.122322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:01Z,description=,direction='ingress',ethertype='IPv6',id=9cdf3ab0-0ec9-4b6b-9456-2431ca4aa334,normalized_cidr=None,port_range_max=,port_range_min=,project_id='be70ba68d13c4b9bbac7f0d788641990',protocol=,remote_address_group_id=,remote_group_id=79263387-953c-4dca-ad79-82d7ef5dfddb,remote_ip_prefix=,revision_number=0,security_group_id=79263387-953c-4dca-ad79-82d7ef5dfddb,updated_at=2022-09-30T09:54:01Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:02.124588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (9cdf3ab0-0ec9-4b6b-9456-2431ca4aa334), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:02.125090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Security group rule updated ['79263387-953c-4dca-ad79-82d7ef5dfddb'] Sep 30 09:54:02.355027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:54:02Z,description='',dns_domain=None,id=5a1e7137-2449-44ee-906e-22f03db8693f,mtu=1500,name='tempest-VolumesActionsTest-621098537-network',project_id='be70ba68d13c4b9bbac7f0d788641990',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(5a1e7137-2449-44ee-906e-22f03db8693f),segments=[NetworkSegment(de250b29-7a8c-4e83-9608-2b5dc8fb63c8)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:54:02Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:02.355529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (5a1e7137-2449-44ee-906e-22f03db8693f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:02.479752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-8064e738-4f25-4f58-bb79-f0e2a4879e43 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5a1e7137-2449-44ee-906e-22f03db8693f with segmentation id not found. Sep 30 09:54:02.479752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:54:02.479752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:54:02.479752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:54:02.479752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:54:02.479752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:54:02.479752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:54:02.479752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:54:02.479752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:54:02.479752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:54:02.479752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:54:02.479752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:54:02.479752 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:54:02.480762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:54:02.480762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:54:02.480762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:54:02.480762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 5a1e7137-2449-44ee-906e-22f03db8693f with segmentation id not found. Sep 30 09:54:02.480762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:54:02.519897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:494 started Sep 30 09:54:02.525978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05e6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=23000000,duration_sec=1001,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:02.526891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:02.527444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:494 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:54:03.444592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d7af9521-5301-4376-89ee-e90489ff2e63 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Resource Port deleted: 6b819bd9-3ae7-4382-b77d-c975f03af861 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:03.444592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d7af9521-5301-4376-89ee-e90489ff2e63 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (6b819bd9-3ae7-4382-b77d-c975f03af861), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:03.517185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5890343e-3e89-4197-89c0-ab6926d27ae0 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(dd654785-5d61-4095-a875-8d74ceaebc28)],cidr=172.20.0.0/28,created_at=2022-09-30T09:54:02Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=False,gateway_ip=172.20.0.1,host_routes=[],id=958c4917-11ad-4f3f-a34a-20ec01439ebc,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-VolumesActionsTest-621098537-subnet',network_id=5a1e7137-2449-44ee-906e-22f03db8693f,project_id='be70ba68d13c4b9bbac7f0d788641990',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:54:02Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:03.517185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5890343e-3e89-4197-89c0-ab6926d27ae0 admin admin] Publish callbacks [] for Subnet (958c4917-11ad-4f3f-a34a-20ec01439ebc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:04.519992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:495 started Sep 30 09:54:04.522896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05e8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=22000000,duration_sec=1003,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:04.523799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:04.524883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:495 - starting polling. Elapsed:0.004 Sep 30 09:54:04.527611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:04.529506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 6b819bd9-3ae7-4382-b77d-c975f03af861 not present in bridge br-int Sep 30 09:54:04.530040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:54:04.530489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['6b819bd9-3ae7-4382-b77d-c975f03af861'] Sep 30 09:54:04.531002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 6b819bd9-3ae7-4382-b77d-c975f03af861 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:54:04.557974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:495 - port information retrieved. Elapsed:0.038 Sep 30 09:54:04.565623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:495 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.046 Sep 30 09:54:06.521865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:496 started Sep 30 09:54:06.524485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=24000000,duration_sec=1005,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:06.528352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:06.528352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:496 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:08.523275 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:497 started Sep 30 09:54:08.525662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=25000000,duration_sec=1007,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:08.526232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:08.526985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:497 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:09.380597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-45795630-073a-40a3-b472-0a7239f46646 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Resource Port deleted: 803fcd8d-66b3-48a0-bc79-84c2e79f336c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:09.386430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-45795630-073a-40a3-b472-0a7239f46646 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (803fcd8d-66b3-48a0-bc79-84c2e79f336c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:09.386430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-45795630-073a-40a3-b472-0a7239f46646 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group member updated {'2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'} Sep 30 09:54:10.524695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:498 started Sep 30 09:54:10.529155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05ee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=27000000,duration_sec=1009,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:10.529155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:10.529155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:498 - starting polling. Elapsed:0.003 Sep 30 09:54:10.530575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:10.532363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 803fcd8d-66b3-48a0-bc79-84c2e79f336c not present in bridge br-int Sep 30 09:54:10.532707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:54:10.533011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['803fcd8d-66b3-48a0-bc79-84c2e79f336c'] Sep 30 09:54:10.533340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 803fcd8d-66b3-48a0-bc79-84c2e79f336c is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:54:10.537359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:498 - port information retrieved. Elapsed:0.013 Sep 30 09:54:10.537693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:498 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 30 09:54:12.185021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Resource SecurityGroup deleted: 2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:12.185514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:12.185804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:54:12.200264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:54:12.200264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Resource SecurityGroupRule deleted: 37333e6e-2fb9-4291-89cd-bceec12da950 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:12.200637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (37333e6e-2fb9-4291-89cd-bceec12da950), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:12.200971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:54:12.201352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Resource SecurityGroupRule deleted: 973134bc-2d04-4b78-b2c0-d6f8c6f66729 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:12.201690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (973134bc-2d04-4b78-b2c0-d6f8c6f66729), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:12.202004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:54:12.202395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Resource SecurityGroupRule deleted: d855724b-57aa-4d94-86ad-4b66bfe5f227 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:12.202756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d855724b-57aa-4d94-86ad-4b66bfe5f227), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:12.203066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:54:12.203428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Resource SecurityGroupRule deleted: 8875b040-3b63-4112-bf2b-e479c030eaf3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:12.203761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8875b040-3b63-4112-bf2b-e479c030eaf3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:12.204069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:54:12.204451 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Resource SecurityGroupRule deleted: 466ab988-f8fa-4878-b411-66fe3343962e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:12.204781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (466ab988-f8fa-4878-b411-66fe3343962e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:12.205088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:54:12.205453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Resource SecurityGroupRule deleted: 7be4f570-f126-457a-80d8-5d3d09d484bc {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:12.206431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7be4f570-f126-457a-80d8-5d3d09d484bc), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:12.206781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:54:12.207144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Resource SecurityGroupRule deleted: 29d89b33-2458-4cc8-859e-a8cd82d02cde {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:12.207486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (29d89b33-2458-4cc8-859e-a8cd82d02cde), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:12.207792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:54:12.208174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Resource SecurityGroupRule deleted: 3e0e51b2-8684-422a-8032-3300f4b2cf68 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:12.208548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (3e0e51b2-8684-422a-8032-3300f4b2cf68), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:12.208853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bf5fafec-3b75-4570-a186-3c8cb9e07636 tempest-TestShelveInstance-2098923934 tempest-TestShelveInstance-2098923934-project] Security group rule updated ['2ff93ac4-5e35-4051-a2ce-f3bd87fbbc7f'] Sep 30 09:54:12.525837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:499 started Sep 30 09:54:12.528508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=28000000,duration_sec=1011,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:12.529082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:12.529430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:499 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:14.307657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8f48193d-bb58-435b-8830-b1ed54df5bc3 admin admin] Resource Port deleted: 6becbba2-d82d-4e76-9a4a-a17dc48fbef1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:14.308243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8f48193d-bb58-435b-8830-b1ed54df5bc3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (6becbba2-d82d-4e76-9a4a-a17dc48fbef1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:14.526864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:500 started Sep 30 09:54:14.529253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05f2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=29000000,duration_sec=1013,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:14.530071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:14.530197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:500 - starting polling. Elapsed:0.004 Sep 30 09:54:14.532722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:14.536626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-6becbba2-d8, col_values=(('tag', 4095),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:54:14.545821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c05f4,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:14.546205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['6becbba2-d82d-4e76-9a4a-a17dc48fbef1'] Sep 30 09:54:14.546675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:54:14.586862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dc2071-a4a4-4bfe-a894-730fb269b447]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:54:14.591199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:500 - port information retrieved. Elapsed:0.064 Sep 30 09:54:14.591545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:500 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.065 Sep 30 09:54:15.551807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["9076636a-4694-4e8a-8920-e087f25c2f86","delete","qr-6becbba2-d8",22,["map",[["attached-mac","fa:16:3e:75:89:a1"],["iface-id","6becbba2-d82d-4e76-9a4a-a17dc48fbef1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:54:15.740254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-00987589-18e1-451e-a2a6-d02087b8a751 admin admin] Resource Port deleted: c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:15.740726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-00987589-18e1-451e-a2a6-d02087b8a751 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:16.274808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d73ab5b1-8cc7-4def-bbb2-3c9433c49b7b","delete","qg-c3b02e0e-6a",23,["map",[["attached-mac","fa:16:3e:af:aa:77"],["iface-id","c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:54:16.418540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-773a997c-85d2-498c-b34c-d693e324974b admin admin] Resource Subnet deleted: 6f26d679-c954-4e46-831c-7bd0a36da165 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:16.419013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-773a997c-85d2-498c-b34c-d693e324974b admin admin] Publish callbacks [] for Subnet (6f26d679-c954-4e46-831c-7bd0a36da165), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:16.527858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:501 started Sep 30 09:54:16.531660 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=31000000,duration_sec=1015,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:16.532232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:16.533362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:501 - starting polling. Elapsed:0.006 Sep 30 09:54:16.536299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:16.541615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c05f8,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 22}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:16.543354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c05fa,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 23}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:16.543667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:501 - port information retrieved. Elapsed:0.016 Sep 30 09:54:16.544008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '5ce7c4c9-91a6-4157-b354-718efb743f8e', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '94897731-51b0-456e-b633-f954a65edcca', '6b2eeaac-b65e-4315-9e6b-2f3f7f643e90', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '419b6762-0832-495f-98ee-a4ec35979ac6', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:54:16.544332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:501 - agent port security group processed in 0.000 Sep 30 09:54:16.547136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:54:16.547683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1'} Sep 30 09:54:16.548231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 6becbba2-d82d-4e76-9a4a-a17dc48fbef1 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:54:16.548818 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:54:16.551969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5aab9120-3b9e-4768-b20d-e0151fd41c04","delete","tap94897731-51",21,["map",[["attached-mac","fa:16:3e:11:73:97"],["iface-id","94897731-51b0-456e-b633-f954a65edcca"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:54:16.625354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b061a4-075e-4a08-9b0c-c4f50b715b0c]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:54:16.626546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'c3b02e0e-6a9c-4a86-bee5-39f0e40bc0b6', '6becbba2-d82d-4e76-9a4a-a17dc48fbef1'} removed Sep 30 09:54:16.716426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:54:16.717047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:54:16.717429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:501 - treat_devices_removed completed in 0.170 Sep 30 09:54:16.717767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:501 - ports processed. Elapsed:0.190 Sep 30 09:54:16.718077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:501 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.190 Sep 30 09:54:16.818368 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-125c58e5-0e79-4b59-8b89-f031bc3f5dcb admin admin] Resource Port deleted: 94897731-51b0-456e-b633-f954a65edcca {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:16.818886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-125c58e5-0e79-4b59-8b89-f031bc3f5dcb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (94897731-51b0-456e-b633-f954a65edcca), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:16.859035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-563f3bd7-0158-4d12-b508-88106fc4d76c None None] Resource Port deleted: 94897731-51b0-456e-b633-f954a65edcca {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:16.859452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-563f3bd7-0158-4d12-b508-88106fc4d76c None None] Skipped duplicate delete event for 94897731-51b0-456e-b633-f954a65edcca {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 30 09:54:17.136782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-125c58e5-0e79-4b59-8b89-f031bc3f5dcb admin admin] Resource Network deleted: 66e518e7-6dfd-46cc-b9d0-1baf366ca8b7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:17.137232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-125c58e5-0e79-4b59-8b89-f031bc3f5dcb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (66e518e7-6dfd-46cc-b9d0-1baf366ca8b7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:17.728983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 869788d7-cd2f-4701-b6bd-a6f79a97b732 updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:54:17.729621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (869788d7-cd2f-4701-b6bd-a6f79a97b732), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:18.083392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-72cfb3e0-5047-458a-86c5-2623b02192bb admin admin] Resource Port deleted: 228a7290-58e9-40fa-a1a4-8aaa9c72f58e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:18.085492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-72cfb3e0-5047-458a-86c5-2623b02192bb admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (228a7290-58e9-40fa-a1a4-8aaa9c72f58e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:18.528691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:502 started Sep 30 09:54:18.531474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c05fc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=31000000,duration_sec=1017,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:18.532086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:18.532526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:502 - starting polling. Elapsed:0.004 Sep 30 09:54:18.534842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:18.538082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-228a7290-58, col_values=(('tag', 4095),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:54:18.546020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c05fe,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:18.546545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['228a7290-58e9-40fa-a1a4-8aaa9c72f58e'] Sep 30 09:54:18.548525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:54:18.602920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c884ae5-7399-4de6-a6b4-a5c3f07c50d5]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:54:18.608970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0600,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 21}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:18.609487 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:502 - port information retrieved. Elapsed:0.081 Sep 30 09:54:18.610005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '5ce7c4c9-91a6-4157-b354-718efb743f8e', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '6b2eeaac-b65e-4315-9e6b-2f3f7f643e90', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '419b6762-0832-495f-98ee-a4ec35979ac6', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'94897731-51b0-456e-b633-f954a65edcca'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:54:18.610509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:502 - agent port security group processed in 0.000 Sep 30 09:54:18.613455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:54:18.613917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'94897731-51b0-456e-b633-f954a65edcca'} Sep 30 09:54:18.614513 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:54:18.670756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[476ff1b3-4269-449b-8a94-6b3ca763fe8f]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:54:18.671594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'94897731-51b0-456e-b633-f954a65edcca'} removed Sep 30 09:54:18.708306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:54:18.708885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Reclaiming vlan = 9 from net-id = 66e518e7-6dfd-46cc-b9d0-1baf366ca8b7, seg-id = 381 Sep 30 09:54:18.713169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xc9105f08,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16864421859504038737,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4105}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:18.716029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xf1c0602,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4477}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:18.716426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:502 - treat_devices_removed completed in 0.102 Sep 30 09:54:18.717914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:502 - ports processed. Elapsed:0.188 Sep 30 09:54:18.718244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:502 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.190 Sep 30 09:54:19.134215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3c812403-b8e5-4e4f-9881-614e15ee7487","delete","qr-228a7290-58",26,["map",[["attached-mac","fa:16:3e:5d:6c:ad"],["iface-id","228a7290-58e9-40fa-a1a4-8aaa9c72f58e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:54:19.295912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e99058af-6f02-4a88-ad1b-d8fdbc4838bf admin admin] Resource Port deleted: 5ce7c4c9-91a6-4157-b354-718efb743f8e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:19.297270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e99058af-6f02-4a88-ad1b-d8fdbc4838bf admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (5ce7c4c9-91a6-4157-b354-718efb743f8e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:19.540812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["89387653-c212-4ce5-81a0-5e7a15cd35a2","delete","qg-5ce7c4c9-91",25,["map",[["attached-mac","fa:16:3e:d6:7f:eb"],["iface-id","5ce7c4c9-91a6-4157-b354-718efb743f8e"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:54:19.617745 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 869788d7-cd2f-4701-b6bd-a6f79a97b732 updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:54:19.618126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (869788d7-cd2f-4701-b6bd-a6f79a97b732), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:20.037906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1bedf74f-4618-4670-a3a2-0e054201c6ea admin admin] Resource Subnet deleted: cb979a21-95fe-4786-aec7-486f57a26635 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:20.039202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1bedf74f-4618-4670-a3a2-0e054201c6ea admin admin] Publish callbacks [] for Subnet (cb979a21-95fe-4786-aec7-486f57a26635), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:20.216814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3063bcdd-1ea8-44a4-95f2-007bbeb64b72","delete","tap369d3278-0f",24,["map",[["attached-mac","fa:16:3e:ef:5c:1c"],["iface-id","369d3278-0f1d-4fb4-82c6-97d7f3b3655d"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:54:20.450936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7b7c076e-5828-4b40-ae2d-f4a86e6609c3 admin admin] Resource Port deleted: 369d3278-0f1d-4fb4-82c6-97d7f3b3655d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:20.451344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7b7c076e-5828-4b40-ae2d-f4a86e6609c3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (369d3278-0f1d-4fb4-82c6-97d7f3b3655d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:20.480546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-90204262-e1c9-440b-b536-a639fbf9123f None None] Resource Port deleted: 369d3278-0f1d-4fb4-82c6-97d7f3b3655d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:20.481767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-90204262-e1c9-440b-b536-a639fbf9123f None None] Skipped duplicate delete event for 369d3278-0f1d-4fb4-82c6-97d7f3b3655d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 30 09:54:20.530199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:503 started Sep 30 09:54:20.533032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0604,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=33000000,duration_sec=1019,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:20.533626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:20.534695 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:503 - starting polling. Elapsed:0.005 Sep 30 09:54:20.536878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:20.541839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0606,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 24}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:20.543664 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0608,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 25}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:20.545361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c060a,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 26}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:20.545678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:503 - port information retrieved. Elapsed:0.016 Sep 30 09:54:20.546017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '6b2eeaac-b65e-4315-9e6b-2f3f7f643e90', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '419b6762-0832-495f-98ee-a4ec35979ac6', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '5ce7c4c9-91a6-4157-b354-718efb743f8e'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:54:20.546545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:503 - agent port security group processed in 0.000 Sep 30 09:54:20.551426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:54:20.551426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '5ce7c4c9-91a6-4157-b354-718efb743f8e'} Sep 30 09:54:20.551645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 228a7290-58e9-40fa-a1a4-8aaa9c72f58e is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:54:20.552405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 8 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:54:20.592175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b06a25-7c48-4f00-837b-e40d1a9cd262]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:54:20.592803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'369d3278-0f1d-4fb4-82c6-97d7f3b3655d', '228a7290-58e9-40fa-a1a4-8aaa9c72f58e', '5ce7c4c9-91a6-4157-b354-718efb743f8e'} removed Sep 30 09:54:20.662347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:54:20.662815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Reclaiming vlan = 10 from net-id = a62b74a3-1997-4c61-bbde-a23d7b16ffe0, seg-id = 353 Sep 30 09:54:20.666046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xc9105f0a,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16864421859504038737,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4106}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:20.668373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xf1c060c,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4449}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:20.668726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:54:20.669105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:503 - treat_devices_removed completed in 0.118 Sep 30 09:54:20.669393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:503 - ports processed. Elapsed:0.139 Sep 30 09:54:20.669716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:503 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 3}}. Elapsed:0.140 Sep 30 09:54:21.000302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7b7c076e-5828-4b40-ae2d-f4a86e6609c3 admin admin] Resource Network deleted: a62b74a3-1997-4c61-bbde-a23d7b16ffe0 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:21.000780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7b7c076e-5828-4b40-ae2d-f4a86e6609c3 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (a62b74a3-1997-4c61-bbde-a23d7b16ffe0), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:21.402052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-761f1fe5-df01-4048-99ec-30c257ad7c65 admin admin] Resource Subnet deleted: d2263e17-d5e3-4d55-a22b-94f76cff031b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:21.402688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-761f1fe5-df01-4048-99ec-30c257ad7c65 admin admin] Publish callbacks [] for Subnet (d2263e17-d5e3-4d55-a22b-94f76cff031b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:21.525894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Resource SecurityGroup deleted: 678c2b98-c42e-4f11-8ae6-0d474af1da3e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:21.526638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (678c2b98-c42e-4f11-8ae6-0d474af1da3e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:21.527903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('678c2b98-c42e-4f11-8ae6-0d474af1da3e',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:54:21.545673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('678c2b98-c42e-4f11-8ae6-0d474af1da3e',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:54:21.546852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Resource SecurityGroupRule deleted: 1162f1ba-0b0b-4739-a2c9-4fa2c56f595d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:21.548897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (1162f1ba-0b0b-4739-a2c9-4fa2c56f595d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:21.550804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Security group rule updated ['678c2b98-c42e-4f11-8ae6-0d474af1da3e'] Sep 30 09:54:21.552952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Resource SecurityGroupRule deleted: 3a6d57f7-7f75-4381-8903-5bbadf1aa63b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:21.552952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (3a6d57f7-7f75-4381-8903-5bbadf1aa63b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:21.552952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Security group rule updated ['678c2b98-c42e-4f11-8ae6-0d474af1da3e'] Sep 30 09:54:21.554147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Resource SecurityGroupRule deleted: 5e36a194-734a-481b-93d5-9d57ebd6ed4f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:21.554791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5e36a194-734a-481b-93d5-9d57ebd6ed4f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:21.555444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Security group rule updated ['678c2b98-c42e-4f11-8ae6-0d474af1da3e'] Sep 30 09:54:21.555957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Resource SecurityGroupRule deleted: a9b795a3-b5b4-47cb-9690-7b72e82b38b5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:21.556458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a9b795a3-b5b4-47cb-9690-7b72e82b38b5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:21.557025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-994f273b-f74c-44ef-8b9c-b38322098945 admin admin] Security group rule updated ['678c2b98-c42e-4f11-8ae6-0d474af1da3e'] Sep 30 09:54:21.796199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d29ca48c-c402-46f1-8c0a-b1f99cc71090 admin admin] Resource Network deleted: 5c0f05c7-ec18-4e10-b234-25cee24d83c9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:21.805779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d29ca48c-c402-46f1-8c0a-b1f99cc71090 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (5c0f05c7-ec18-4e10-b234-25cee24d83c9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:22.059857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-53a42795-31d6-4c9b-8def-68ab3a880516 admin admin] Resource Subnet deleted: 958c4917-11ad-4f3f-a34a-20ec01439ebc {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:22.059857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-53a42795-31d6-4c9b-8def-68ab3a880516 admin admin] Publish callbacks [] for Subnet (958c4917-11ad-4f3f-a34a-20ec01439ebc), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:22.530853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:504 started Sep 30 09:54:22.533260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c060e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=33000000,duration_sec=1021,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:22.534417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:22.534799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:504 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:22.697137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-485f2779-3e56-4dcd-8a25-fd60fc7b19e6 admin admin] Resource Network deleted: 5a1e7137-2449-44ee-906e-22f03db8693f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:22.697598 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-485f2779-3e56-4dcd-8a25-fd60fc7b19e6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (5a1e7137-2449-44ee-906e-22f03db8693f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:22.700857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Resource SecurityGroup deleted: 29ade661-fd3d-44f0-8558-9190e721e633 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:22.701585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (29ade661-fd3d-44f0-8558-9190e721e633), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:22.702038 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('29ade661-fd3d-44f0-8558-9190e721e633',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:54:22.719294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('29ade661-fd3d-44f0-8558-9190e721e633',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:54:22.719835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Resource SecurityGroupRule deleted: 05c6d347-8e98-4b80-bbcd-7b7c0ca398e4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:22.720327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (05c6d347-8e98-4b80-bbcd-7b7c0ca398e4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:22.720533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Security group rule updated ['29ade661-fd3d-44f0-8558-9190e721e633'] Sep 30 09:54:22.720925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Resource SecurityGroupRule deleted: 4ac29be5-d48e-4656-86af-eaa45b659f8c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:22.721296 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4ac29be5-d48e-4656-86af-eaa45b659f8c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:22.721617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Security group rule updated ['29ade661-fd3d-44f0-8558-9190e721e633'] Sep 30 09:54:22.721986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Resource SecurityGroupRule deleted: e57acd40-abcc-4ffe-b902-5e40262e5750 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:22.722331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e57acd40-abcc-4ffe-b902-5e40262e5750), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:22.722688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Security group rule updated ['29ade661-fd3d-44f0-8558-9190e721e633'] Sep 30 09:54:22.723057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Resource SecurityGroupRule deleted: f661d7bd-453a-48d4-84bf-8932966f3f31 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:22.723396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f661d7bd-453a-48d4-84bf-8932966f3f31), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:22.723898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ed8ba38d-bead-4582-bbcd-6797f9977bab admin admin] Security group rule updated ['29ade661-fd3d-44f0-8558-9190e721e633'] Sep 30 09:54:23.387278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Resource SecurityGroup deleted: ddaf52f4-42a5-4b87-bd61-830bc1dc11fe {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:23.388123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (ddaf52f4-42a5-4b87-bd61-830bc1dc11fe), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:23.388856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('ddaf52f4-42a5-4b87-bd61-830bc1dc11fe',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:54:23.406427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('ddaf52f4-42a5-4b87-bd61-830bc1dc11fe',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:54:23.406929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Resource SecurityGroupRule deleted: 07b3e9a4-a58c-4a3d-9405-6392283fa33c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:23.407299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (07b3e9a4-a58c-4a3d-9405-6392283fa33c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:23.407629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Security group rule updated ['ddaf52f4-42a5-4b87-bd61-830bc1dc11fe'] Sep 30 09:54:23.408048 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Resource SecurityGroupRule deleted: 10c652fc-b2dd-46ce-ab83-aa27afb4145a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:23.408393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (10c652fc-b2dd-46ce-ab83-aa27afb4145a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:23.409212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Security group rule updated ['ddaf52f4-42a5-4b87-bd61-830bc1dc11fe'] Sep 30 09:54:23.409579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Resource SecurityGroupRule deleted: 90a61c87-3901-4788-86f8-aaf67440dc3d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:23.409920 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (90a61c87-3901-4788-86f8-aaf67440dc3d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:23.410276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Security group rule updated ['ddaf52f4-42a5-4b87-bd61-830bc1dc11fe'] Sep 30 09:54:23.410676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Resource SecurityGroupRule deleted: ebaa3bb6-55fd-4046-ab9d-1d0368954798 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:23.411026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (ebaa3bb6-55fd-4046-ab9d-1d0368954798), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:23.411421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3ad81356-ccf9-432b-b06c-533cc4658156 admin admin] Security group rule updated ['ddaf52f4-42a5-4b87-bd61-830bc1dc11fe'] Sep 30 09:54:24.347866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Resource SecurityGroup deleted: 79263387-953c-4dca-ad79-82d7ef5dfddb {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:24.347866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (79263387-953c-4dca-ad79-82d7ef5dfddb), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:24.348613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('79263387-953c-4dca-ad79-82d7ef5dfddb',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:54:24.361776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('79263387-953c-4dca-ad79-82d7ef5dfddb',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:54:24.362245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Resource SecurityGroupRule deleted: 1870c845-92a0-40c1-878c-a0106c0d1d20 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:24.362637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (1870c845-92a0-40c1-878c-a0106c0d1d20), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:24.362972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Security group rule updated ['79263387-953c-4dca-ad79-82d7ef5dfddb'] Sep 30 09:54:24.363414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Resource SecurityGroupRule deleted: 4925506b-4ab6-484f-ba4a-dd623f61342b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:24.363773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4925506b-4ab6-484f-ba4a-dd623f61342b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:24.364094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Security group rule updated ['79263387-953c-4dca-ad79-82d7ef5dfddb'] Sep 30 09:54:24.364466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Resource SecurityGroupRule deleted: 80e2e968-d0be-4282-907d-b90425e991b8 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:24.364810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (80e2e968-d0be-4282-907d-b90425e991b8), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:24.365129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Security group rule updated ['79263387-953c-4dca-ad79-82d7ef5dfddb'] Sep 30 09:54:24.365494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Resource SecurityGroupRule deleted: 9cdf3ab0-0ec9-4b6b-9456-2431ca4aa334 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:24.365836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (9cdf3ab0-0ec9-4b6b-9456-2431ca4aa334), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:24.366194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ecd11e25-19e5-4809-bb5d-a59d3a1222a4 admin admin] Security group rule updated ['79263387-953c-4dca-ad79-82d7ef5dfddb'] Sep 30 09:54:24.531560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:505 started Sep 30 09:54:24.534475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0610,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=34000000,duration_sec=1023,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:24.535145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:24.535564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:505 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:26.536325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:506 started Sep 30 09:54:26.538715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0612,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=39000000,duration_sec=1025,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:26.539281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:26.539637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:506 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:54:28.533320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:507 started Sep 30 09:54:28.536371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0614,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=36000000,duration_sec=1027,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:28.536956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:28.537304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:507 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:30.534253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:508 started Sep 30 09:54:30.536683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0616,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=37000000,duration_sec=1029,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:30.537253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:30.537626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:508 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:32.534862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:509 started Sep 30 09:54:32.537280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0618,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=37000000,duration_sec=1031,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:32.537843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:32.538189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:509 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:34.539192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:510 started Sep 30 09:54:34.541618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c061a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=41000000,duration_sec=1033,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:34.542182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:34.542527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:510 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:54:36.540484 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:511 started Sep 30 09:54:36.543324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c061c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=43000000,duration_sec=1035,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:36.543918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:36.544269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:511 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:38.129534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:54:37Z,description='Default security group',id=c97a9480-8735-42d1-a39d-4dc1e65caabe,is_default=True,name='default',project_id='2d30e521c04f4e85bd8d25c794704372',revision_number=1,rules=[SecurityGroupRule(011b7cfd-e840-44f4-973c-1dede558e558),SecurityGroupRule(5a0e8edc-4cae-4557-bb15-a5ca76b90319),SecurityGroupRule(c3728d10-6fd9-4e31-9c19-16e462b05d02),SecurityGroupRule(f29687ed-5b0b-4ce6-8852-5699486b439f)],shared=False,stateful=True,updated_at=2022-09-30T09:54:37Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:38.130135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (c97a9480-8735-42d1-a39d-4dc1e65caabe), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:38.130528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:38Z,description=,direction='egress',ethertype='IPv6',id=011b7cfd-e840-44f4-973c-1dede558e558,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2d30e521c04f4e85bd8d25c794704372',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c97a9480-8735-42d1-a39d-4dc1e65caabe,updated_at=2022-09-30T09:54:38Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:38.130927 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (011b7cfd-e840-44f4-973c-1dede558e558), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:38.131259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Security group rule updated ['c97a9480-8735-42d1-a39d-4dc1e65caabe'] Sep 30 09:54:38.131933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:37Z,description=,direction='egress',ethertype='IPv4',id=5a0e8edc-4cae-4557-bb15-a5ca76b90319,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2d30e521c04f4e85bd8d25c794704372',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c97a9480-8735-42d1-a39d-4dc1e65caabe,updated_at=2022-09-30T09:54:37Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:38.132308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5a0e8edc-4cae-4557-bb15-a5ca76b90319), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:38.132637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Security group rule updated ['c97a9480-8735-42d1-a39d-4dc1e65caabe'] Sep 30 09:54:38.133300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:37Z,description=,direction='ingress',ethertype='IPv6',id=c3728d10-6fd9-4e31-9c19-16e462b05d02,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2d30e521c04f4e85bd8d25c794704372',protocol=,remote_address_group_id=,remote_group_id=c97a9480-8735-42d1-a39d-4dc1e65caabe,remote_ip_prefix=,revision_number=0,security_group_id=c97a9480-8735-42d1-a39d-4dc1e65caabe,updated_at=2022-09-30T09:54:37Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:38.133650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c3728d10-6fd9-4e31-9c19-16e462b05d02), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:38.133971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Security group rule updated ['c97a9480-8735-42d1-a39d-4dc1e65caabe'] Sep 30 09:54:38.134645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:37Z,description=,direction='ingress',ethertype='IPv4',id=f29687ed-5b0b-4ce6-8852-5699486b439f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='2d30e521c04f4e85bd8d25c794704372',protocol=,remote_address_group_id=,remote_group_id=c97a9480-8735-42d1-a39d-4dc1e65caabe,remote_ip_prefix=,revision_number=0,security_group_id=c97a9480-8735-42d1-a39d-4dc1e65caabe,updated_at=2022-09-30T09:54:37Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:38.134994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (f29687ed-5b0b-4ce6-8852-5699486b439f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:38.135317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-d4a48bdf-8997-4c48-8916-f2ee79570550 admin admin] Security group rule updated ['c97a9480-8735-42d1-a39d-4dc1e65caabe'] Sep 30 09:54:38.330159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Resource SecurityGroup deleted: c97a9480-8735-42d1-a39d-4dc1e65caabe {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:38.330555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (c97a9480-8735-42d1-a39d-4dc1e65caabe), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:38.331047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c97a9480-8735-42d1-a39d-4dc1e65caabe',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:54:38.343676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c97a9480-8735-42d1-a39d-4dc1e65caabe',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:54:38.344143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Resource SecurityGroupRule deleted: 011b7cfd-e840-44f4-973c-1dede558e558 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:38.344553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (011b7cfd-e840-44f4-973c-1dede558e558), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:38.344863 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Security group rule updated ['c97a9480-8735-42d1-a39d-4dc1e65caabe'] Sep 30 09:54:38.345249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Resource SecurityGroupRule deleted: 5a0e8edc-4cae-4557-bb15-a5ca76b90319 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:38.345599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5a0e8edc-4cae-4557-bb15-a5ca76b90319), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:38.345950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Security group rule updated ['c97a9480-8735-42d1-a39d-4dc1e65caabe'] Sep 30 09:54:38.346353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Resource SecurityGroupRule deleted: c3728d10-6fd9-4e31-9c19-16e462b05d02 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:38.346736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c3728d10-6fd9-4e31-9c19-16e462b05d02), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:38.347550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Security group rule updated ['c97a9480-8735-42d1-a39d-4dc1e65caabe'] Sep 30 09:54:38.347975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Resource SecurityGroupRule deleted: f29687ed-5b0b-4ce6-8852-5699486b439f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:38.348478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (f29687ed-5b0b-4ce6-8852-5699486b439f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:38.348665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-665c0a8f-c248-4d53-b7d5-a4aa6bc56664 admin admin] Security group rule updated ['c97a9480-8735-42d1-a39d-4dc1e65caabe'] Sep 30 09:54:38.542053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:512 started Sep 30 09:54:38.546613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c061e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=45000000,duration_sec=1037,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:38.546613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:38.546613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:512 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:39.061912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:54:38Z,description='Default security group',id=d292a73c-5052-4cb5-a736-2db9519df40c,is_default=True,name='default',project_id='b9f56079af3f4222a5673d4cd1eab194',revision_number=1,rules=[SecurityGroupRule(18998d20-bae6-4b5a-a5e6-c1733b7b78ff),SecurityGroupRule(98357c4a-f450-489d-8dbe-fe26cdee6ff9),SecurityGroupRule(b69a625d-0f55-48cd-8247-252d6f28fdb1),SecurityGroupRule(c9e64034-9750-473a-a090-d7daf91cdf0c)],shared=False,stateful=True,updated_at=2022-09-30T09:54:38Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:39.062287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (d292a73c-5052-4cb5-a736-2db9519df40c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:39.063010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:38Z,description=,direction='ingress',ethertype='IPv6',id=18998d20-bae6-4b5a-a5e6-c1733b7b78ff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b9f56079af3f4222a5673d4cd1eab194',protocol=,remote_address_group_id=,remote_group_id=d292a73c-5052-4cb5-a736-2db9519df40c,remote_ip_prefix=,revision_number=0,security_group_id=d292a73c-5052-4cb5-a736-2db9519df40c,updated_at=2022-09-30T09:54:38Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:39.063371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (18998d20-bae6-4b5a-a5e6-c1733b7b78ff), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:39.063709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Security group rule updated ['d292a73c-5052-4cb5-a736-2db9519df40c'] Sep 30 09:54:39.064378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:38Z,description=,direction='ingress',ethertype='IPv4',id=98357c4a-f450-489d-8dbe-fe26cdee6ff9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b9f56079af3f4222a5673d4cd1eab194',protocol=,remote_address_group_id=,remote_group_id=d292a73c-5052-4cb5-a736-2db9519df40c,remote_ip_prefix=,revision_number=0,security_group_id=d292a73c-5052-4cb5-a736-2db9519df40c,updated_at=2022-09-30T09:54:38Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:39.064729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (98357c4a-f450-489d-8dbe-fe26cdee6ff9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:39.065157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Security group rule updated ['d292a73c-5052-4cb5-a736-2db9519df40c'] Sep 30 09:54:39.066329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:38Z,description=,direction='egress',ethertype='IPv6',id=b69a625d-0f55-48cd-8247-252d6f28fdb1,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b9f56079af3f4222a5673d4cd1eab194',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d292a73c-5052-4cb5-a736-2db9519df40c,updated_at=2022-09-30T09:54:38Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:39.066700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b69a625d-0f55-48cd-8247-252d6f28fdb1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:39.067053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Security group rule updated ['d292a73c-5052-4cb5-a736-2db9519df40c'] Sep 30 09:54:39.067722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:38Z,description=,direction='egress',ethertype='IPv4',id=c9e64034-9750-473a-a090-d7daf91cdf0c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='b9f56079af3f4222a5673d4cd1eab194',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=d292a73c-5052-4cb5-a736-2db9519df40c,updated_at=2022-09-30T09:54:38Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:39.068071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c9e64034-9750-473a-a090-d7daf91cdf0c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:39.068390 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4a4c0427-db39-453f-aff0-b0e8403d6ac1 admin admin] Security group rule updated ['d292a73c-5052-4cb5-a736-2db9519df40c'] Sep 30 09:54:39.279670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Resource SecurityGroup deleted: d292a73c-5052-4cb5-a736-2db9519df40c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:39.280240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (d292a73c-5052-4cb5-a736-2db9519df40c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:39.280619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('d292a73c-5052-4cb5-a736-2db9519df40c',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:54:39.293985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('d292a73c-5052-4cb5-a736-2db9519df40c',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:54:39.295614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Resource SecurityGroupRule deleted: 18998d20-bae6-4b5a-a5e6-c1733b7b78ff {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:39.295614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (18998d20-bae6-4b5a-a5e6-c1733b7b78ff), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:39.295614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Security group rule updated ['d292a73c-5052-4cb5-a736-2db9519df40c'] Sep 30 09:54:39.295933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Resource SecurityGroupRule deleted: 98357c4a-f450-489d-8dbe-fe26cdee6ff9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:39.296483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (98357c4a-f450-489d-8dbe-fe26cdee6ff9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:39.296906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Security group rule updated ['d292a73c-5052-4cb5-a736-2db9519df40c'] Sep 30 09:54:39.297341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Resource SecurityGroupRule deleted: b69a625d-0f55-48cd-8247-252d6f28fdb1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:39.297783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b69a625d-0f55-48cd-8247-252d6f28fdb1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:39.298191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Security group rule updated ['d292a73c-5052-4cb5-a736-2db9519df40c'] Sep 30 09:54:39.298811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Resource SecurityGroupRule deleted: c9e64034-9750-473a-a090-d7daf91cdf0c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:39.299138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c9e64034-9750-473a-a090-d7daf91cdf0c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:39.299523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f4ea9404-f9b1-4fd7-8d6c-26cfb0e09344 admin admin] Security group rule updated ['d292a73c-5052-4cb5-a736-2db9519df40c'] Sep 30 09:54:40.542960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:513 started Sep 30 09:54:40.545702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0620,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=45000000,duration_sec=1039,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:40.546270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:40.546637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:513 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:41.135725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:54:40Z,description='Default security group',id=a570dc99-7c88-4a56-bf96-c9bdf5261707,is_default=True,name='default',project_id='609696f6bc224cb9ad0532f2ff62b926',revision_number=1,rules=[SecurityGroupRule(2ba61f4c-db09-45ef-9caa-0e494950ff1f),SecurityGroupRule(5cc48cf4-eb93-4938-866c-76e9d00f1acd),SecurityGroupRule(887be253-6093-4785-806a-e9d73b8b04f5),SecurityGroupRule(b0c4a684-a50a-4af2-91dd-a39c586e7b71)],shared=False,stateful=True,updated_at=2022-09-30T09:54:40Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:41.136108 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (a570dc99-7c88-4a56-bf96-c9bdf5261707), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:41.136741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:41Z,description=,direction='ingress',ethertype='IPv6',id=2ba61f4c-db09-45ef-9caa-0e494950ff1f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='609696f6bc224cb9ad0532f2ff62b926',protocol=,remote_address_group_id=,remote_group_id=a570dc99-7c88-4a56-bf96-c9bdf5261707,remote_ip_prefix=,revision_number=0,security_group_id=a570dc99-7c88-4a56-bf96-c9bdf5261707,updated_at=2022-09-30T09:54:41Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:41.137382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (2ba61f4c-db09-45ef-9caa-0e494950ff1f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:41.137821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Security group rule updated ['a570dc99-7c88-4a56-bf96-c9bdf5261707'] Sep 30 09:54:41.138507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:40Z,description=,direction='egress',ethertype='IPv4',id=5cc48cf4-eb93-4938-866c-76e9d00f1acd,normalized_cidr=None,port_range_max=,port_range_min=,project_id='609696f6bc224cb9ad0532f2ff62b926',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a570dc99-7c88-4a56-bf96-c9bdf5261707,updated_at=2022-09-30T09:54:40Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:41.138891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5cc48cf4-eb93-4938-866c-76e9d00f1acd), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:41.139222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Security group rule updated ['a570dc99-7c88-4a56-bf96-c9bdf5261707'] Sep 30 09:54:41.140104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:41Z,description=,direction='egress',ethertype='IPv6',id=887be253-6093-4785-806a-e9d73b8b04f5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='609696f6bc224cb9ad0532f2ff62b926',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=a570dc99-7c88-4a56-bf96-c9bdf5261707,updated_at=2022-09-30T09:54:41Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:41.140458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (887be253-6093-4785-806a-e9d73b8b04f5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:41.140817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Security group rule updated ['a570dc99-7c88-4a56-bf96-c9bdf5261707'] Sep 30 09:54:41.141483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:40Z,description=,direction='ingress',ethertype='IPv4',id=b0c4a684-a50a-4af2-91dd-a39c586e7b71,normalized_cidr=None,port_range_max=,port_range_min=,project_id='609696f6bc224cb9ad0532f2ff62b926',protocol=,remote_address_group_id=,remote_group_id=a570dc99-7c88-4a56-bf96-c9bdf5261707,remote_ip_prefix=,revision_number=0,security_group_id=a570dc99-7c88-4a56-bf96-c9bdf5261707,updated_at=2022-09-30T09:54:40Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:41.141834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b0c4a684-a50a-4af2-91dd-a39c586e7b71), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:41.142158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-cb11e0bc-7058-407e-983f-c0fc9c4078a4 admin admin] Security group rule updated ['a570dc99-7c88-4a56-bf96-c9bdf5261707'] Sep 30 09:54:41.687528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Resource SecurityGroup deleted: a570dc99-7c88-4a56-bf96-c9bdf5261707 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:41.688169 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (a570dc99-7c88-4a56-bf96-c9bdf5261707), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:41.688339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('a570dc99-7c88-4a56-bf96-c9bdf5261707',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:54:41.703325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('a570dc99-7c88-4a56-bf96-c9bdf5261707',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:54:41.703802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Resource SecurityGroupRule deleted: 2ba61f4c-db09-45ef-9caa-0e494950ff1f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:41.704172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2ba61f4c-db09-45ef-9caa-0e494950ff1f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:41.704506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Security group rule updated ['a570dc99-7c88-4a56-bf96-c9bdf5261707'] Sep 30 09:54:41.704898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Resource SecurityGroupRule deleted: 5cc48cf4-eb93-4938-866c-76e9d00f1acd {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:41.705240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5cc48cf4-eb93-4938-866c-76e9d00f1acd), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:41.705738 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Security group rule updated ['a570dc99-7c88-4a56-bf96-c9bdf5261707'] Sep 30 09:54:41.706136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Resource SecurityGroupRule deleted: 887be253-6093-4785-806a-e9d73b8b04f5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:41.707608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (887be253-6093-4785-806a-e9d73b8b04f5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:41.707936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Security group rule updated ['a570dc99-7c88-4a56-bf96-c9bdf5261707'] Sep 30 09:54:41.708798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Resource SecurityGroupRule deleted: b0c4a684-a50a-4af2-91dd-a39c586e7b71 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:41.709151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b0c4a684-a50a-4af2-91dd-a39c586e7b71), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:41.709594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3d5b9684-6f34-4da7-8f88-71660e03819b admin admin] Security group rule updated ['a570dc99-7c88-4a56-bf96-c9bdf5261707'] Sep 30 09:54:42.138362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9f72a74a-fa91-4492-a4cf-9bbf689a4c17 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource Port deleted: c69dcca2-dd34-464e-98ba-2697ae2f9628 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:42.142499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9f72a74a-fa91-4492-a4cf-9bbf689a4c17 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (c69dcca2-dd34-464e-98ba-2697ae2f9628), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:42.142499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9f72a74a-fa91-4492-a4cf-9bbf689a4c17 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group member updated {'6fa83794-f114-4d02-9d65-747e3bcbcdb0'} Sep 30 09:54:42.544404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:514 started Sep 30 09:54:42.547202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0622,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=47000000,duration_sec=1041,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:42.547790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:42.548143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:514 - starting polling. Elapsed:0.004 Sep 30 09:54:42.550697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:42.552103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port c69dcca2-dd34-464e-98ba-2697ae2f9628 not present in bridge br-int Sep 30 09:54:42.552438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:54:42.552949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['c69dcca2-dd34-464e-98ba-2697ae2f9628'] Sep 30 09:54:42.553298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port c69dcca2-dd34-464e-98ba-2697ae2f9628 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:54:42.557338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:514 - port information retrieved. Elapsed:0.013 Sep 30 09:54:42.557683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:514 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.013 Sep 30 09:54:44.545253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:515 started Sep 30 09:54:44.547842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0624,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=48000000,duration_sec=1043,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:44.548449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:44.548826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:515 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:46.546619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:516 started Sep 30 09:54:46.549058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0626,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=49000000,duration_sec=1045,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:46.549628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:46.550027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:516 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:48.547991 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:517 started Sep 30 09:54:48.551650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0628,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=51000000,duration_sec=1047,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:48.552322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:48.552795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:517 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:54:49.365286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f5f04f05-9c83-4a3b-b29c-b9661645e1ae tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:54:48Z,data_plane_status=None,description='',device_id='3ee8e26b-68fe-4a79-a257-1d9456e4b22b',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3570f723-a6b6-479e-9662-f90c771a0449,mac_address=fa:16:3e:e0:eb:01,name='',network_id=3408b8b1-1a84-4fa0-8af6-da7419c2525d,numa_affinity_policy=,project_id='f0d0c96bbb304882b1f2459361551a93',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3570f723-a6b6-479e-9662-f90c771a0449),security_group_ids=set([6fa83794-f114-4d02-9d65-747e3bcbcdb0]),status='DOWN',updated_at=2022-09-30T09:54:49Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:49.365999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f5f04f05-9c83-4a3b-b29c-b9661645e1ae tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3570f723-a6b6-479e-9662-f90c771a0449), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:49.366691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f5f04f05-9c83-4a3b-b29c-b9661645e1ae tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group member updated {'6fa83794-f114-4d02-9d65-747e3bcbcdb0'} Sep 30 09:54:50.006582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-521bdb2a-4432-478e-bf05-87b78df1e769 service neutron] Resource Port 3570f723-a6b6-479e-9662-f90c771a0449 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=3570f723-a6b6-479e-9662-f90c771a0449,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=3570f723-a6b6-479e-9662-f90c771a0449,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:54:50.007237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-521bdb2a-4432-478e-bf05-87b78df1e769 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3570f723-a6b6-479e-9662-f90c771a0449), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:50.363376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-521bdb2a-4432-478e-bf05-87b78df1e769 service neutron] Resource Port 3570f723-a6b6-479e-9662-f90c771a0449 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=3570f723-a6b6-479e-9662-f90c771a0449,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=3570f723-a6b6-479e-9662-f90c771a0449,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=3570f723-a6b6-479e-9662-f90c771a0449,segment=NetworkSegment(765b8827-dc41-4d9e-be01-6115a3b03c81),segment_id=765b8827-dc41-4d9e-be01-6115a3b03c81)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:54:50.363759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-521bdb2a-4432-478e-bf05-87b78df1e769 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3570f723-a6b6-479e-9662-f90c771a0449), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:50.549452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:518 started Sep 30 09:54:50.553835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c062a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=53000000,duration_sec=1049,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:50.561529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:50.561529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:518 - starting polling. Elapsed:0.006 Sep 30 09:54:50.561529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:50.561529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:518 - port information retrieved. Elapsed:0.011 Sep 30 09:54:50.561529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:518 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:54:52.549821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:519 started Sep 30 09:54:52.556468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c062c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=52000000,duration_sec=1051,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:52.557071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:52.557425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:519 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:54:53.444728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:54:53Z,description='Default security group',id=8ffe5073-db4f-47e1-9489-68748acf4c1e,is_default=True,name='default',project_id='9512c7b73e85419a86ba54d674de615a',revision_number=1,rules=[SecurityGroupRule(4fb3e5d2-0a7a-46ae-a3d5-29879071f9c5),SecurityGroupRule(69e27080-513f-4da0-b79e-95ae7dc4ee5c),SecurityGroupRule(87aecde8-753b-418a-8d3f-1cbcbb5e58f6),SecurityGroupRule(de2e2007-ab61-4c6f-8753-c25c90309c46)],shared=False,stateful=True,updated_at=2022-09-30T09:54:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:53.445193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (8ffe5073-db4f-47e1-9489-68748acf4c1e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:53.446068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:53Z,description=,direction='ingress',ethertype='IPv4',id=4fb3e5d2-0a7a-46ae-a3d5-29879071f9c5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9512c7b73e85419a86ba54d674de615a',protocol=,remote_address_group_id=,remote_group_id=8ffe5073-db4f-47e1-9489-68748acf4c1e,remote_ip_prefix=,revision_number=0,security_group_id=8ffe5073-db4f-47e1-9489-68748acf4c1e,updated_at=2022-09-30T09:54:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:53.446422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4fb3e5d2-0a7a-46ae-a3d5-29879071f9c5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:53.446853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Security group rule updated ['8ffe5073-db4f-47e1-9489-68748acf4c1e'] Sep 30 09:54:53.447592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:53Z,description=,direction='egress',ethertype='IPv4',id=69e27080-513f-4da0-b79e-95ae7dc4ee5c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9512c7b73e85419a86ba54d674de615a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8ffe5073-db4f-47e1-9489-68748acf4c1e,updated_at=2022-09-30T09:54:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:53.448013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (69e27080-513f-4da0-b79e-95ae7dc4ee5c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:53.448454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Security group rule updated ['8ffe5073-db4f-47e1-9489-68748acf4c1e'] Sep 30 09:54:53.449119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:53Z,description=,direction='ingress',ethertype='IPv6',id=87aecde8-753b-418a-8d3f-1cbcbb5e58f6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9512c7b73e85419a86ba54d674de615a',protocol=,remote_address_group_id=,remote_group_id=8ffe5073-db4f-47e1-9489-68748acf4c1e,remote_ip_prefix=,revision_number=0,security_group_id=8ffe5073-db4f-47e1-9489-68748acf4c1e,updated_at=2022-09-30T09:54:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:53.449473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (87aecde8-753b-418a-8d3f-1cbcbb5e58f6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:53.449800 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Security group rule updated ['8ffe5073-db4f-47e1-9489-68748acf4c1e'] Sep 30 09:54:53.450558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:53Z,description=,direction='egress',ethertype='IPv6',id=de2e2007-ab61-4c6f-8753-c25c90309c46,normalized_cidr=None,port_range_max=,port_range_min=,project_id='9512c7b73e85419a86ba54d674de615a',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=8ffe5073-db4f-47e1-9489-68748acf4c1e,updated_at=2022-09-30T09:54:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:53.450943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (de2e2007-ab61-4c6f-8753-c25c90309c46), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:53.451269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9d011834-731e-47d6-8fb6-080b67c9c35b admin admin] Security group rule updated ['8ffe5073-db4f-47e1-9489-68748acf4c1e'] Sep 30 09:54:53.691552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Resource SecurityGroup deleted: 8ffe5073-db4f-47e1-9489-68748acf4c1e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:53.692182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (8ffe5073-db4f-47e1-9489-68748acf4c1e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:53.692379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8ffe5073-db4f-47e1-9489-68748acf4c1e',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:54:53.705145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8ffe5073-db4f-47e1-9489-68748acf4c1e',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:54:53.712506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Resource SecurityGroupRule deleted: 4fb3e5d2-0a7a-46ae-a3d5-29879071f9c5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:53.712506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4fb3e5d2-0a7a-46ae-a3d5-29879071f9c5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:53.712506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Security group rule updated ['8ffe5073-db4f-47e1-9489-68748acf4c1e'] Sep 30 09:54:53.712506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Resource SecurityGroupRule deleted: 69e27080-513f-4da0-b79e-95ae7dc4ee5c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:53.712506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (69e27080-513f-4da0-b79e-95ae7dc4ee5c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:53.713086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Security group rule updated ['8ffe5073-db4f-47e1-9489-68748acf4c1e'] Sep 30 09:54:53.713086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Resource SecurityGroupRule deleted: 87aecde8-753b-418a-8d3f-1cbcbb5e58f6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:53.713086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (87aecde8-753b-418a-8d3f-1cbcbb5e58f6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:53.713086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Security group rule updated ['8ffe5073-db4f-47e1-9489-68748acf4c1e'] Sep 30 09:54:53.713086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Resource SecurityGroupRule deleted: de2e2007-ab61-4c6f-8753-c25c90309c46 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:53.713496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (de2e2007-ab61-4c6f-8753-c25c90309c46), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:53.713496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-52d967d3-9872-4c1b-8072-893495f5de30 admin admin] Security group rule updated ['8ffe5073-db4f-47e1-9489-68748acf4c1e'] Sep 30 09:54:54.550921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:520 started Sep 30 09:54:54.554364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c062e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=54000000,duration_sec=1053,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:54.558536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:54.558536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:520 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:54:54.574488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:54:54Z,description='Default security group',id=1659980f-20cd-47bc-a717-0dac1f19cc14,is_default=True,name='default',project_id='3d6fedd1f0bc434d9aa2711c2693baf3',revision_number=1,rules=[SecurityGroupRule(4bb801bb-6354-4460-b8cb-fa7290f9e203),SecurityGroupRule(857f9384-3cd9-4558-ad7c-0c9bd3856411),SecurityGroupRule(ab47f80c-c8e2-47b2-ab41-9ef942b645f0),SecurityGroupRule(d29ee037-ecab-4620-8501-21d20bfd287d)],shared=False,stateful=True,updated_at=2022-09-30T09:54:54Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:54.574984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (1659980f-20cd-47bc-a717-0dac1f19cc14), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:54.575688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:54Z,description=,direction='ingress',ethertype='IPv6',id=4bb801bb-6354-4460-b8cb-fa7290f9e203,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3d6fedd1f0bc434d9aa2711c2693baf3',protocol=,remote_address_group_id=,remote_group_id=1659980f-20cd-47bc-a717-0dac1f19cc14,remote_ip_prefix=,revision_number=0,security_group_id=1659980f-20cd-47bc-a717-0dac1f19cc14,updated_at=2022-09-30T09:54:54Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:54.576082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4bb801bb-6354-4460-b8cb-fa7290f9e203), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:54.576591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Security group rule updated ['1659980f-20cd-47bc-a717-0dac1f19cc14'] Sep 30 09:54:54.577322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:54Z,description=,direction='ingress',ethertype='IPv4',id=857f9384-3cd9-4558-ad7c-0c9bd3856411,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3d6fedd1f0bc434d9aa2711c2693baf3',protocol=,remote_address_group_id=,remote_group_id=1659980f-20cd-47bc-a717-0dac1f19cc14,remote_ip_prefix=,revision_number=0,security_group_id=1659980f-20cd-47bc-a717-0dac1f19cc14,updated_at=2022-09-30T09:54:54Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:54.577683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (857f9384-3cd9-4558-ad7c-0c9bd3856411), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:54.578008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Security group rule updated ['1659980f-20cd-47bc-a717-0dac1f19cc14'] Sep 30 09:54:54.578696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:54Z,description=,direction='egress',ethertype='IPv4',id=ab47f80c-c8e2-47b2-ab41-9ef942b645f0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3d6fedd1f0bc434d9aa2711c2693baf3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1659980f-20cd-47bc-a717-0dac1f19cc14,updated_at=2022-09-30T09:54:54Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:54.579051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (ab47f80c-c8e2-47b2-ab41-9ef942b645f0), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:54.579376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Security group rule updated ['1659980f-20cd-47bc-a717-0dac1f19cc14'] Sep 30 09:54:54.580033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:54Z,description=,direction='egress',ethertype='IPv6',id=d29ee037-ecab-4620-8501-21d20bfd287d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='3d6fedd1f0bc434d9aa2711c2693baf3',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=1659980f-20cd-47bc-a717-0dac1f19cc14,updated_at=2022-09-30T09:54:54Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:54.580389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d29ee037-ecab-4620-8501-21d20bfd287d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:54.580712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e755f031-5b80-4dc6-9a48-6ce61ba8ec78 admin admin] Security group rule updated ['1659980f-20cd-47bc-a717-0dac1f19cc14'] Sep 30 09:54:54.780919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Resource SecurityGroup deleted: 1659980f-20cd-47bc-a717-0dac1f19cc14 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:54.781485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (1659980f-20cd-47bc-a717-0dac1f19cc14), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:54.781742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('1659980f-20cd-47bc-a717-0dac1f19cc14',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:54:54.797549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('1659980f-20cd-47bc-a717-0dac1f19cc14',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:54:54.798130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Resource SecurityGroupRule deleted: 4bb801bb-6354-4460-b8cb-fa7290f9e203 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:54.798497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4bb801bb-6354-4460-b8cb-fa7290f9e203), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:54.798874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Security group rule updated ['1659980f-20cd-47bc-a717-0dac1f19cc14'] Sep 30 09:54:54.799435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Resource SecurityGroupRule deleted: 857f9384-3cd9-4558-ad7c-0c9bd3856411 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:54.799783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (857f9384-3cd9-4558-ad7c-0c9bd3856411), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:54.800103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Security group rule updated ['1659980f-20cd-47bc-a717-0dac1f19cc14'] Sep 30 09:54:54.800479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Resource SecurityGroupRule deleted: ab47f80c-c8e2-47b2-ab41-9ef942b645f0 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:54.800873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (ab47f80c-c8e2-47b2-ab41-9ef942b645f0), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:54.801765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Security group rule updated ['1659980f-20cd-47bc-a717-0dac1f19cc14'] Sep 30 09:54:54.802130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Resource SecurityGroupRule deleted: d29ee037-ecab-4620-8501-21d20bfd287d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:54.802674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d29ee037-ecab-4620-8501-21d20bfd287d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:54.802995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ed4cacc0-acc3-4a82-869f-7ade3fc913ab admin admin] Security group rule updated ['1659980f-20cd-47bc-a717-0dac1f19cc14'] Sep 30 09:54:55.586246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:54:55Z,description='Default security group',id=57559a50-9458-4e88-98cb-a9c5186610f4,is_default=True,name='default',project_id='f51afa50ac314b9495ecdc8141506d89',revision_number=1,rules=[SecurityGroupRule(3b2659a0-6187-4323-970e-9606260e7deb),SecurityGroupRule(56521246-9b17-4094-b954-60777e6b728a),SecurityGroupRule(9e1b926c-ed23-48d9-ab9b-a2bd02c1b922),SecurityGroupRule(cb9161b9-79b8-4126-ad8a-43a56c305de6)],shared=False,stateful=True,updated_at=2022-09-30T09:54:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:55.586943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (57559a50-9458-4e88-98cb-a9c5186610f4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:55.587637 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:55Z,description=,direction='ingress',ethertype='IPv6',id=3b2659a0-6187-4323-970e-9606260e7deb,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f51afa50ac314b9495ecdc8141506d89',protocol=,remote_address_group_id=,remote_group_id=57559a50-9458-4e88-98cb-a9c5186610f4,remote_ip_prefix=,revision_number=0,security_group_id=57559a50-9458-4e88-98cb-a9c5186610f4,updated_at=2022-09-30T09:54:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:55.588062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (3b2659a0-6187-4323-970e-9606260e7deb), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:55.588458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Security group rule updated ['57559a50-9458-4e88-98cb-a9c5186610f4'] Sep 30 09:54:55.589198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:55Z,description=,direction='egress',ethertype='IPv4',id=56521246-9b17-4094-b954-60777e6b728a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f51afa50ac314b9495ecdc8141506d89',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=57559a50-9458-4e88-98cb-a9c5186610f4,updated_at=2022-09-30T09:54:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:55.589788 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (56521246-9b17-4094-b954-60777e6b728a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:55.590178 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Security group rule updated ['57559a50-9458-4e88-98cb-a9c5186610f4'] Sep 30 09:54:55.590923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:55Z,description=,direction='egress',ethertype='IPv6',id=9e1b926c-ed23-48d9-ab9b-a2bd02c1b922,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f51afa50ac314b9495ecdc8141506d89',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=57559a50-9458-4e88-98cb-a9c5186610f4,updated_at=2022-09-30T09:54:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:55.591335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (9e1b926c-ed23-48d9-ab9b-a2bd02c1b922), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:55.591719 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Security group rule updated ['57559a50-9458-4e88-98cb-a9c5186610f4'] Sep 30 09:54:55.592439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:54:55Z,description=,direction='ingress',ethertype='IPv4',id=cb9161b9-79b8-4126-ad8a-43a56c305de6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='f51afa50ac314b9495ecdc8141506d89',protocol=,remote_address_group_id=,remote_group_id=57559a50-9458-4e88-98cb-a9c5186610f4,remote_ip_prefix=,revision_number=0,security_group_id=57559a50-9458-4e88-98cb-a9c5186610f4,updated_at=2022-09-30T09:54:55Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:54:55.593000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (cb9161b9-79b8-4126-ad8a-43a56c305de6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:55.593481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5975db2c-eb88-400b-8488-a901a771ea4b admin admin] Security group rule updated ['57559a50-9458-4e88-98cb-a9c5186610f4'] Sep 30 09:54:55.850237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Resource SecurityGroup deleted: 57559a50-9458-4e88-98cb-a9c5186610f4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:55.850836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (57559a50-9458-4e88-98cb-a9c5186610f4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:55.851293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('57559a50-9458-4e88-98cb-a9c5186610f4',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:54:55.871067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('57559a50-9458-4e88-98cb-a9c5186610f4',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:54:55.871600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Resource SecurityGroupRule deleted: 3b2659a0-6187-4323-970e-9606260e7deb {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:55.872027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (3b2659a0-6187-4323-970e-9606260e7deb), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:55.872423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Security group rule updated ['57559a50-9458-4e88-98cb-a9c5186610f4'] Sep 30 09:54:55.872877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Resource SecurityGroupRule deleted: 56521246-9b17-4094-b954-60777e6b728a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:55.873283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (56521246-9b17-4094-b954-60777e6b728a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:55.873663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Security group rule updated ['57559a50-9458-4e88-98cb-a9c5186610f4'] Sep 30 09:54:55.874097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Resource SecurityGroupRule deleted: 9e1b926c-ed23-48d9-ab9b-a2bd02c1b922 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:55.874504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (9e1b926c-ed23-48d9-ab9b-a2bd02c1b922), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:55.874946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Security group rule updated ['57559a50-9458-4e88-98cb-a9c5186610f4'] Sep 30 09:54:55.875404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Resource SecurityGroupRule deleted: cb9161b9-79b8-4126-ad8a-43a56c305de6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:54:55.875836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (cb9161b9-79b8-4126-ad8a-43a56c305de6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:54:55.876260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2230b1dd-8713-43e6-8308-153927b67cb7 admin admin] Security group rule updated ['57559a50-9458-4e88-98cb-a9c5186610f4'] Sep 30 09:54:56.552060 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:521 started Sep 30 09:54:56.554822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0630,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=54000000,duration_sec=1055,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:56.555393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:56.555786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:521 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:58.553059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:522 started Sep 30 09:54:58.555532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0632,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=55000000,duration_sec=1057,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:54:58.556094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:54:58.556443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:522 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:54:59.829819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 3570f723-a6b6-479e-9662-f90c771a0449 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:54:59.830397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3570f723-a6b6-479e-9662-f90c771a0449), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:00.554200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:523 started Sep 30 09:55:00.556652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0634,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=56000000,duration_sec=1059,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:00.557256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:00.557611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:523 - starting polling. Elapsed:0.004 Sep 30 09:55:00.559673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:00.562253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:523 - port information retrieved. Elapsed:0.008 Sep 30 09:55:00.562604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:523 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:55:01.919937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 3570f723-a6b6-479e-9662-f90c771a0449 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:55:01.920514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3570f723-a6b6-479e-9662-f90c771a0449), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:02.555104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:524 started Sep 30 09:55:02.557821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0636,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=57000000,duration_sec=1061,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:02.558413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:02.558770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:524 - starting polling. Elapsed:0.004 Sep 30 09:55:02.560797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:02.563407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:524 - port information retrieved. Elapsed:0.009 Sep 30 09:55:02.563737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:524 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:55:02.856712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ce37f47b-6886-4268-ae78-9275404ac1b1 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource Port deleted: 869788d7-cd2f-4701-b6bd-a6f79a97b732 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:55:02.857261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ce37f47b-6886-4268-ae78-9275404ac1b1 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (869788d7-cd2f-4701-b6bd-a6f79a97b732), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:02.857850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ce37f47b-6886-4268-ae78-9275404ac1b1 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group member updated {'951ad8ca-ad5f-4420-bbe5-c5c64ad050b4'} Sep 30 09:55:04.556483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:525 started Sep 30 09:55:04.559626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0638,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=59000000,duration_sec=1063,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:04.560252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:04.560616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:525 - starting polling. Elapsed:0.004 Sep 30 09:55:04.563303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:04.565036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 869788d7-cd2f-4701-b6bd-a6f79a97b732 not present in bridge br-int Sep 30 09:55:04.565492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:55:04.565785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['869788d7-cd2f-4701-b6bd-a6f79a97b732'] Sep 30 09:55:04.566112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 869788d7-cd2f-4701-b6bd-a6f79a97b732 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:55:04.569256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:525 - port information retrieved. Elapsed:0.013 Sep 30 09:55:04.569903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:525 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.014 Sep 30 09:55:04.866238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2a120456-cb24-49f9-a2a0-d935954068aa tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:55:04Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=cdcd3d52-4f21-4eeb-b6a1-a3d8fee30e42,mac_address=fa:16:3e:d5:41:a9,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(cdcd3d52-4f21-4eeb-b6a1-a3d8fee30e42),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T09:55:04Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:55:04.866724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2a120456-cb24-49f9-a2a0-d935954068aa tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (cdcd3d52-4f21-4eeb-b6a1-a3d8fee30e42), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:05.724567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource SecurityGroup deleted: 951ad8ca-ad5f-4420-bbe5-c5c64ad050b4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:55:05.725261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (951ad8ca-ad5f-4420-bbe5-c5c64ad050b4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:05.725770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('951ad8ca-ad5f-4420-bbe5-c5c64ad050b4',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:55:05.740292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('951ad8ca-ad5f-4420-bbe5-c5c64ad050b4',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:55:05.740846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource SecurityGroupRule deleted: e210e033-f60b-4060-b2d9-017b77f6ceed {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:55:05.741539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e210e033-f60b-4060-b2d9-017b77f6ceed), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:05.742494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['951ad8ca-ad5f-4420-bbe5-c5c64ad050b4'] Sep 30 09:55:05.743002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource SecurityGroupRule deleted: fbeb1252-2357-45cd-84d5-f91af4fdc28d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:55:05.743630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (fbeb1252-2357-45cd-84d5-f91af4fdc28d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:05.744194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['951ad8ca-ad5f-4420-bbe5-c5c64ad050b4'] Sep 30 09:55:05.744764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource SecurityGroupRule deleted: 6f0f3466-b03c-4510-a77d-c82e759088c2 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:55:05.745319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (6f0f3466-b03c-4510-a77d-c82e759088c2), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:05.745864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['951ad8ca-ad5f-4420-bbe5-c5c64ad050b4'] Sep 30 09:55:05.746627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource SecurityGroupRule deleted: 8f64812b-cb30-4fb9-83a9-f8ebfe1a7c54 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:55:05.747061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8f64812b-cb30-4fb9-83a9-f8ebfe1a7c54), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:05.747476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a49a5efb-d429-4be1-b3a2-8fb5cfaf211e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['951ad8ca-ad5f-4420-bbe5-c5c64ad050b4'] Sep 30 09:55:05.753040 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2a120456-cb24-49f9-a2a0-d935954068aa tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource Port cdcd3d52-4f21-4eeb-b6a1-a3d8fee30e42 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'b5950227-9cea-481f-bfa5-ea7140e22d74'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:55:05.753517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2a120456-cb24-49f9-a2a0-d935954068aa tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (cdcd3d52-4f21-4eeb-b6a1-a3d8fee30e42), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:06.160537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-379d5ae3-49de-4b9b-97bc-a13abc44173e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource Port deleted: 8d7849f8-8e67-4398-8b1b-8662626b1602 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:55:06.161386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-379d5ae3-49de-4b9b-97bc-a13abc44173e tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (8d7849f8-8e67-4398-8b1b-8662626b1602), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:06.557220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:526 started Sep 30 09:55:06.566948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c063a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=60000000,duration_sec=1065,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:06.566948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:06.566948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:526 - starting polling. Elapsed:0.004 Sep 30 09:55:06.566948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:06.567557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 8d7849f8-8e67-4398-8b1b-8662626b1602 not present in bridge br-int Sep 30 09:55:06.567557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:55:06.567557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['8d7849f8-8e67-4398-8b1b-8662626b1602'] Sep 30 09:55:06.567557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 8d7849f8-8e67-4398-8b1b-8662626b1602 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:55:06.568851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:526 - port information retrieved. Elapsed:0.012 Sep 30 09:55:06.569191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:526 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.012 Sep 30 09:55:06.692519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2318e7d1-9661-47a2-a43f-ed48d4a9da42 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:55:06Z,description='tempest-description--681415686',id=c5fe62fb-9dbb-448f-becd-597b2be6c5d3,is_default=False,name='tempest-securitygroup--539401786',project_id='1142014cc9284cf1833e5bfbcdb41599',revision_number=1,rules=[SecurityGroupRule(37f04d82-89de-4711-8f9d-75db493f1974),SecurityGroupRule(4b419b6a-16f2-49b4-9355-1b6cd11dbff5)],shared=False,stateful=True,updated_at=2022-09-30T09:55:06Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:55:06.696944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2318e7d1-9661-47a2-a43f-ed48d4a9da42 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (c5fe62fb-9dbb-448f-becd-597b2be6c5d3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:06.696944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2318e7d1-9661-47a2-a43f-ed48d4a9da42 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:55:06Z,description=,direction='egress',ethertype='IPv6',id=37f04d82-89de-4711-8f9d-75db493f1974,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1142014cc9284cf1833e5bfbcdb41599',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c5fe62fb-9dbb-448f-becd-597b2be6c5d3,updated_at=2022-09-30T09:55:06Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:55:06.696944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2318e7d1-9661-47a2-a43f-ed48d4a9da42 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (37f04d82-89de-4711-8f9d-75db493f1974), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:06.697289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2318e7d1-9661-47a2-a43f-ed48d4a9da42 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['c5fe62fb-9dbb-448f-becd-597b2be6c5d3'] Sep 30 09:55:06.697289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2318e7d1-9661-47a2-a43f-ed48d4a9da42 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:55:06Z,description=,direction='egress',ethertype='IPv4',id=4b419b6a-16f2-49b4-9355-1b6cd11dbff5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1142014cc9284cf1833e5bfbcdb41599',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c5fe62fb-9dbb-448f-becd-597b2be6c5d3,updated_at=2022-09-30T09:55:06Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:55:06.697289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2318e7d1-9661-47a2-a43f-ed48d4a9da42 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (4b419b6a-16f2-49b4-9355-1b6cd11dbff5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:06.697289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2318e7d1-9661-47a2-a43f-ed48d4a9da42 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['c5fe62fb-9dbb-448f-becd-597b2be6c5d3'] Sep 30 09:55:06.987955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-07525564-2509-4de5-ab52-1a1f40c63fb0 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:55:06Z,description='',direction='ingress',ethertype='IPv4',id=041b435d-3203-438a-83e3-b76363275329,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='1142014cc9284cf1833e5bfbcdb41599',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c5fe62fb-9dbb-448f-becd-597b2be6c5d3,updated_at=2022-09-30T09:55:06Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:55:06.989254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-07525564-2509-4de5-ab52-1a1f40c63fb0 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (041b435d-3203-438a-83e3-b76363275329), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:06.989392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-07525564-2509-4de5-ab52-1a1f40c63fb0 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['c5fe62fb-9dbb-448f-becd-597b2be6c5d3'] Sep 30 09:55:07.265644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3cd44d9c-d223-460d-ab18-f826d33c7858 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:55:07Z,description='',direction='ingress',ethertype='IPv4',id=1876d655-b786-4e0a-a6b8-f885aafc9b6a,normalized_cidr=None,port_range_max=,port_range_min=,project_id='1142014cc9284cf1833e5bfbcdb41599',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=c5fe62fb-9dbb-448f-becd-597b2be6c5d3,updated_at=2022-09-30T09:55:07Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:55:07.266093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3cd44d9c-d223-460d-ab18-f826d33c7858 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (1876d655-b786-4e0a-a6b8-f885aafc9b6a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:07.266496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-3cd44d9c-d223-460d-ab18-f826d33c7858 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['c5fe62fb-9dbb-448f-becd-597b2be6c5d3'] Sep 30 09:55:08.055190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ebba698e-efaa-4260-a064-25528bfbdfe7 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:55:07Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=33cb1e4a-672a-4375-a3e6-deab9334cdf9,mac_address=fa:16:3e:8d:06:2d,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(33cb1e4a-672a-4375-a3e6-deab9334cdf9),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T09:55:07Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:55:08.056233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ebba698e-efaa-4260-a064-25528bfbdfe7 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (33cb1e4a-672a-4375-a3e6-deab9334cdf9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:08.502012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ebba698e-efaa-4260-a064-25528bfbdfe7 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource Port 33cb1e4a-672a-4375-a3e6-deab9334cdf9 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'f533167c-32ff-4f7d-9755-20dce72681c4'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:55:08.502425 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ebba698e-efaa-4260-a064-25528bfbdfe7 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (33cb1e4a-672a-4375-a3e6-deab9334cdf9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:08.558283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:527 started Sep 30 09:55:08.560661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c063c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=61000000,duration_sec=1067,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:08.561232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:08.561564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:527 - starting polling. Elapsed:0.003 Sep 30 09:55:08.563603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:08.566190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:527 - port information retrieved. Elapsed:0.008 Sep 30 09:55:08.568918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:527 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:55:10.559358 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:528 started Sep 30 09:55:10.561854 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c063e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=62000000,duration_sec=1069,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:10.562412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:10.562782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:528 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:12.200584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2ccba46b-481f-4258-99f8-ef1223e0fcdd tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:55:11Z,data_plane_status=None,description='',device_id='299c80c2-f890-43f2-9e42-86f4939c18df',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5fe64bf6-a448-427d-8a92-4b647a91c107,mac_address=fa:16:3e:69:56:c5,name='',network_id=6555801d-cf6b-484f-a48c-039d4395e1ca,numa_affinity_policy=,project_id='1142014cc9284cf1833e5bfbcdb41599',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5fe64bf6-a448-427d-8a92-4b647a91c107),security_group_ids=set([c5fe62fb-9dbb-448f-becd-597b2be6c5d3]),status='DOWN',updated_at=2022-09-30T09:55:11Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:55:12.201219 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2ccba46b-481f-4258-99f8-ef1223e0fcdd tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5fe64bf6-a448-427d-8a92-4b647a91c107), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:12.201857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-2ccba46b-481f-4258-99f8-ef1223e0fcdd tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group member updated {'c5fe62fb-9dbb-448f-becd-597b2be6c5d3'} Sep 30 09:55:12.560495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:529 started Sep 30 09:55:12.562995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0640,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=63000000,duration_sec=1071,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:12.563568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:12.563901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:529 - starting polling. Elapsed:0.004 Sep 30 09:55:12.565915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:12.569074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:529 - port information retrieved. Elapsed:0.009 Sep 30 09:55:12.569445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:529 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:55:12.807223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-79a3c2d6-c911-400b-81e5-04af39358144 service neutron] Resource Port 5fe64bf6-a448-427d-8a92-4b647a91c107 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=5fe64bf6-a448-427d-8a92-4b647a91c107,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=5fe64bf6-a448-427d-8a92-4b647a91c107,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:55:12.807602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-79a3c2d6-c911-400b-81e5-04af39358144 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5fe64bf6-a448-427d-8a92-4b647a91c107), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:13.122881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-79a3c2d6-c911-400b-81e5-04af39358144 service neutron] Resource Port 5fe64bf6-a448-427d-8a92-4b647a91c107 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=5fe64bf6-a448-427d-8a92-4b647a91c107,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=5fe64bf6-a448-427d-8a92-4b647a91c107,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=5fe64bf6-a448-427d-8a92-4b647a91c107,segment=NetworkSegment(02e0c40d-c6ca-4ad2-9b3f-4b04b702f1ed),segment_id=02e0c40d-c6ca-4ad2-9b3f-4b04b702f1ed)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:55:13.123266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-79a3c2d6-c911-400b-81e5-04af39358144 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5fe64bf6-a448-427d-8a92-4b647a91c107), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:14.561476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:530 started Sep 30 09:55:14.563939 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0642,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=64000000,duration_sec=1073,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:14.564518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:14.564878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:530 - starting polling. Elapsed:0.004 Sep 30 09:55:14.567068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:14.569631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:530 - port information retrieved. Elapsed:0.008 Sep 30 09:55:14.569963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:530 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:55:16.562180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:531 started Sep 30 09:55:16.564632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0644,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=64000000,duration_sec=1075,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:16.565213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:16.565623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:531 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:17.863730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 5fe64bf6-a448-427d-8a92-4b647a91c107 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:55:17.864315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5fe64bf6-a448-427d-8a92-4b647a91c107), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:18.563643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:532 started Sep 30 09:55:18.566718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0646,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=66000000,duration_sec=1077,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:18.567315 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:18.567645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:532 - starting polling. Elapsed:0.004 Sep 30 09:55:18.569671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:18.572251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:532 - port information retrieved. Elapsed:0.009 Sep 30 09:55:18.572576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:532 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:55:19.991592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 5fe64bf6-a448-427d-8a92-4b647a91c107 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:55:19.992278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5fe64bf6-a448-427d-8a92-4b647a91c107), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:20.564753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:533 started Sep 30 09:55:20.567175 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0648,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=67000000,duration_sec=1079,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:20.567761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:20.568099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:533 - starting polling. Elapsed:0.004 Sep 30 09:55:20.570170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:55:20.572815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:533 - port information retrieved. Elapsed:0.008 Sep 30 09:55:20.573149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:533 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:55:22.566428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:534 started Sep 30 09:55:22.569160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c064a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=69000000,duration_sec=1081,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:22.569728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:22.570102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:534 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:24.567361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:535 started Sep 30 09:55:24.569767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c064c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=70000000,duration_sec=1083,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:24.570349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:24.570729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:535 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:26.568849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:536 started Sep 30 09:55:26.571431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c064e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=71000000,duration_sec=1085,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:26.572180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:26.572528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:536 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:28.570267 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:537 started Sep 30 09:55:28.572765 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0650,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=73000000,duration_sec=1087,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:28.573726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:28.574072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:537 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:30.571812 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:538 started Sep 30 09:55:30.574251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0652,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=74000000,duration_sec=1089,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:30.575353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:30.575710 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:538 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:32.573252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:539 started Sep 30 09:55:32.575764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0654,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=75000000,duration_sec=1091,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:32.576331 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:32.576681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:539 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:34.573951 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:540 started Sep 30 09:55:34.576378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0656,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=76000000,duration_sec=1093,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:34.576945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:34.577321 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:540 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:36.575107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:541 started Sep 30 09:55:36.578228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0658,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=77000000,duration_sec=1095,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:36.578228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:36.578468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:541 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:55:38.575862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:542 started Sep 30 09:55:38.578240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c065a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=78000000,duration_sec=1097,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:38.578836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:38.579187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:542 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:40.577312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:543 started Sep 30 09:55:40.580121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c065c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=80000000,duration_sec=1099,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:40.580686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:40.581034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:543 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:42.578018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:544 started Sep 30 09:55:42.580786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c065e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=80000000,duration_sec=1101,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:42.581346 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:42.581694 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:544 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:44.578986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:545 started Sep 30 09:55:44.581417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0660,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=81000000,duration_sec=1103,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:44.581981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:44.582357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:545 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:46.580411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:546 started Sep 30 09:55:46.584420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0662,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=83000000,duration_sec=1105,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:46.584420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:46.584420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:546 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:48.581868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:547 started Sep 30 09:55:48.584283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0664,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=84000000,duration_sec=1107,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:48.584857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:48.585208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:547 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:55:50.583159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:548 started Sep 30 09:55:50.586043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0666,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=85000000,duration_sec=1109,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:50.586652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:50.587004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:548 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:52.583860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:549 started Sep 30 09:55:52.586880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0668,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=86000000,duration_sec=1111,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:52.587439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:52.587823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:549 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:54.584647 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:550 started Sep 30 09:55:54.587064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c066a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=87000000,duration_sec=1113,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:54.587627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:54.587976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:550 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:56.586115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:551 started Sep 30 09:55:56.596084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c066c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=89000000,duration_sec=1115,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:56.596084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:56.596084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:551 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:55:58.587241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:552 started Sep 30 09:55:58.589619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c066e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=89000000,duration_sec=1117,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:55:58.590179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:55:58.590529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:552 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:56:00.588217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:553 started Sep 30 09:56:00.590669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0670,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=90000000,duration_sec=1119,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:00.591235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:00.591588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:553 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:02.589417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:554 started Sep 30 09:56:02.591731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0672,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=92000000,duration_sec=1121,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:02.592291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:02.592636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:554 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:56:04.590249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:555 started Sep 30 09:56:04.592642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0674,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=93000000,duration_sec=1123,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:04.593325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:04.593679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:555 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:06.591184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:556 started Sep 30 09:56:06.601429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0676,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=93000000,duration_sec=1125,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:06.601429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:06.601429 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:556 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:08.592035 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:557 started Sep 30 09:56:08.594379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0678,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=94000000,duration_sec=1127,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:08.594963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:08.595318 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:557 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:56:10.593338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:558 started Sep 30 09:56:10.595770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c067a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=96000000,duration_sec=1129,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:10.596327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:10.596670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:558 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:12.594772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:559 started Sep 30 09:56:12.597571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c067c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=97000000,duration_sec=1131,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:12.598154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:12.598498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:559 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:14.595669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:560 started Sep 30 09:56:14.598715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c067e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=99000000,duration_sec=1133,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:14.599306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:14.599654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:560 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:16.596357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:561 started Sep 30 09:56:16.598783 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0680,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=99000000,duration_sec=1135,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:16.601230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:16.601230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:561 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:18.597235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:562 started Sep 30 09:56:18.599698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0682,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=100000000,duration_sec=1137,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:18.600286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:18.600629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:562 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:20.214718 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 5fe64bf6-a448-427d-8a92-4b647a91c107 updated (revision_number 5->6). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:56:20.215312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5fe64bf6-a448-427d-8a92-4b647a91c107), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:56:20.598170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:563 started Sep 30 09:56:20.600982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0684,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=100000000,duration_sec=1139,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:20.601643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:20.602045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:563 - starting polling. Elapsed:0.004 Sep 30 09:56:20.604197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:56:20.606831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:563 - port information retrieved. Elapsed:0.009 Sep 30 09:56:20.607160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:563 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:56:22.241224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 5fe64bf6-a448-427d-8a92-4b647a91c107 updated (revision_number 6->7). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:56:22.241870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5fe64bf6-a448-427d-8a92-4b647a91c107), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:56:22.598819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:564 started Sep 30 09:56:22.601177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0686,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=101000000,duration_sec=1141,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:22.602648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:22.603213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:564 - starting polling. Elapsed:0.005 Sep 30 09:56:22.605327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:56:22.608532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:564 - port information retrieved. Elapsed:0.010 Sep 30 09:56:22.609129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:564 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:56:24.600983 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:565 started Sep 30 09:56:24.604511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0688,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=103000000,duration_sec=1143,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:24.605193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:24.605795 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:565 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:56:26.601537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:566 started Sep 30 09:56:26.607090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c068a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=104000000,duration_sec=1145,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:26.607090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:26.607090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:566 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:28.602758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:567 started Sep 30 09:56:28.605385 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c068c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=105000000,duration_sec=1147,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:28.606964 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:28.608611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:567 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.006 Sep 30 09:56:30.604013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:568 started Sep 30 09:56:30.607142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c068e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=107000000,duration_sec=1149,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:30.608080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:30.608440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:568 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 09:56:32.605271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:569 started Sep 30 09:56:32.607653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0690,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=107000000,duration_sec=1151,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:32.608240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:32.608588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:569 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:56:34.606290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:570 started Sep 30 09:56:34.609095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0692,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=109000000,duration_sec=1153,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:34.609659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:34.610005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:570 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:36.352195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 5fe64bf6-a448-427d-8a92-4b647a91c107 updated (revision_number 7->8). Old fields: {'status': 'ACTIVE'} New fields: {'status': 'DOWN'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:56:36.352797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5fe64bf6-a448-427d-8a92-4b647a91c107), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:56:36.607426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:571 started Sep 30 09:56:36.609954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0694,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=110000000,duration_sec=1155,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:36.610522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:36.610891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:571 - starting polling. Elapsed:0.004 Sep 30 09:56:36.612971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:56:36.615560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:571 - port information retrieved. Elapsed:0.008 Sep 30 09:56:36.615890 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:571 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:56:38.608609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:572 started Sep 30 09:56:38.611080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0696,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=111000000,duration_sec=1157,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:38.611655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:38.612003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:572 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:40.609398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:573 started Sep 30 09:56:40.611972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0698,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=112000000,duration_sec=1159,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:40.612526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:40.612873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:573 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:42.610669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:574 started Sep 30 09:56:42.613164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c069a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=113000000,duration_sec=1161,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:42.613729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:42.614077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:574 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:44.611550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:575 started Sep 30 09:56:44.614106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c069c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=114000000,duration_sec=1163,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:44.614733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:44.615088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:575 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:46.612897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:576 started Sep 30 09:56:46.615643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c069e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=115000000,duration_sec=1165,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:46.616295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:46.616646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:576 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:48.613603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:577 started Sep 30 09:56:48.615996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=116000000,duration_sec=1167,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:48.616584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:48.616932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:577 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:56:50.614629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:578 started Sep 30 09:56:50.617026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=117000000,duration_sec=1169,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:50.617586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:50.617953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:578 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:52.393530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 5fe64bf6-a448-427d-8a92-4b647a91c107 updated (revision_number 8->9). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:56:52.394139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5fe64bf6-a448-427d-8a92-4b647a91c107), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:56:52.615376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:579 started Sep 30 09:56:52.617757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=118000000,duration_sec=1171,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:52.618326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:52.618685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:579 - starting polling. Elapsed:0.003 Sep 30 09:56:52.620727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:56:52.623339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:579 - port information retrieved. Elapsed:0.008 Sep 30 09:56:52.623670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:579 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:56:54.371052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 5fe64bf6-a448-427d-8a92-4b647a91c107 updated (revision_number 9->10). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:56:54.371645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5fe64bf6-a448-427d-8a92-4b647a91c107), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:56:54.617281 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:580 started Sep 30 09:56:54.621537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=120000000,duration_sec=1173,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:54.622348 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:54.622780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:580 - starting polling. Elapsed:0.006 Sep 30 09:56:54.637197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:56:54.641486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:580 - port information retrieved. Elapsed:0.025 Sep 30 09:56:54.642059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:580 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.026 Sep 30 09:56:56.617576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:581 started Sep 30 09:56:56.620557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=120000000,duration_sec=1175,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:56.621125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:56.621495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:581 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:58.619504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:582 started Sep 30 09:56:58.621962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=122000000,duration_sec=1177,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:56:58.622520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:56:58.622893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:582 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:56:58.784327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e09d7db4-df6e-4c91-a53c-3e086c601d6f tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:56:58Z,data_plane_status=None,description='',device_id='fe3f6880-acc5-4b79-9e64-e6819767007d',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=31deec85-f41f-469f-8cb8-d5828a5ff711,mac_address=fa:16:3e:91:bb:1e,name='',network_id=3408b8b1-1a84-4fa0-8af6-da7419c2525d,numa_affinity_policy=,project_id='f0d0c96bbb304882b1f2459361551a93',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(31deec85-f41f-469f-8cb8-d5828a5ff711),security_group_ids=set([6fa83794-f114-4d02-9d65-747e3bcbcdb0]),status='DOWN',updated_at=2022-09-30T09:56:58Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:56:58.784701 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e09d7db4-df6e-4c91-a53c-3e086c601d6f tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (31deec85-f41f-469f-8cb8-d5828a5ff711), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:56:58.791462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e09d7db4-df6e-4c91-a53c-3e086c601d6f tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group member updated {'6fa83794-f114-4d02-9d65-747e3bcbcdb0'} Sep 30 09:56:59.467011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf915d14-cc1e-4860-b80a-3256c4cc7b03 service neutron] Resource Port 31deec85-f41f-469f-8cb8-d5828a5ff711 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=31deec85-f41f-469f-8cb8-d5828a5ff711,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=31deec85-f41f-469f-8cb8-d5828a5ff711,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:56:59.467387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf915d14-cc1e-4860-b80a-3256c4cc7b03 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (31deec85-f41f-469f-8cb8-d5828a5ff711), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:56:59.788809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bf915d14-cc1e-4860-b80a-3256c4cc7b03 service neutron] Resource Port 31deec85-f41f-469f-8cb8-d5828a5ff711 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=31deec85-f41f-469f-8cb8-d5828a5ff711,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=31deec85-f41f-469f-8cb8-d5828a5ff711,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=31deec85-f41f-469f-8cb8-d5828a5ff711,segment=NetworkSegment(765b8827-dc41-4d9e-be01-6115a3b03c81),segment_id=765b8827-dc41-4d9e-be01-6115a3b03c81)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:56:59.789423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bf915d14-cc1e-4860-b80a-3256c4cc7b03 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (31deec85-f41f-469f-8cb8-d5828a5ff711), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:00.619587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:583 started Sep 30 09:57:00.628725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=122000000,duration_sec=1179,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:00.628725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:00.628725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:583 - starting polling. Elapsed:0.003 Sep 30 09:57:00.628725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:00.629117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:583 - port information retrieved. Elapsed:0.008 Sep 30 09:57:00.629117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:583 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:57:02.620194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:584 started Sep 30 09:57:02.625585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=122000000,duration_sec=1181,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:02.625585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:02.625585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:584 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:57:04.621220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:585 started Sep 30 09:57:04.623621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=123000000,duration_sec=1183,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:04.624184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:04.624534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:585 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:57:06.622046 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:586 started Sep 30 09:57:06.624568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=124000000,duration_sec=1185,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:06.625125 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:06.625472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:586 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:57:08.622898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:587 started Sep 30 09:57:08.625255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=125000000,duration_sec=1187,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:08.625808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:08.626150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:587 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:57:10.501183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 31deec85-f41f-469f-8cb8-d5828a5ff711 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:10.501794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (31deec85-f41f-469f-8cb8-d5828a5ff711), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:10.623782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:588 started Sep 30 09:57:10.626093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=126000000,duration_sec=1189,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:10.626683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:10.627045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:588 - starting polling. Elapsed:0.003 Sep 30 09:57:10.629063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:10.631923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:588 - port information retrieved. Elapsed:0.008 Sep 30 09:57:10.632258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:588 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:57:12.553210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 31deec85-f41f-469f-8cb8-d5828a5ff711 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:12.553915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (31deec85-f41f-469f-8cb8-d5828a5ff711), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:12.624891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:589 started Sep 30 09:57:12.627559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06b8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=127000000,duration_sec=1191,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:12.628174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:12.628541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:589 - starting polling. Elapsed:0.004 Sep 30 09:57:12.630531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:12.633494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:589 - port information retrieved. Elapsed:0.009 Sep 30 09:57:12.633828 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:589 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:57:14.626277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:590 started Sep 30 09:57:14.629101 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06ba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=129000000,duration_sec=1193,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:14.629661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:14.630003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:590 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:57:15.160780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bbbc8939-e239-417b-b7bb-0acd3fb26626 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:57:14Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=3ae594d2-36a9-40e5-a761-ef753fb8256c,mac_address=fa:16:3e:9e:63:4d,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(3ae594d2-36a9-40e5-a761-ef753fb8256c),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T09:57:14Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:15.161160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bbbc8939-e239-417b-b7bb-0acd3fb26626 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3ae594d2-36a9-40e5-a761-ef753fb8256c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:15.881925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bbbc8939-e239-417b-b7bb-0acd3fb26626 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource Port 3ae594d2-36a9-40e5-a761-ef753fb8256c updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '0fdb1fd9-6e22-4259-bcb6-ac0ea320b7ef'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:15.881925 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bbbc8939-e239-417b-b7bb-0acd3fb26626 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (3ae594d2-36a9-40e5-a761-ef753fb8256c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:16.627526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:591 started Sep 30 09:57:16.630218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=130000000,duration_sec=1195,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:16.630846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:16.631583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:591 - starting polling. Elapsed:0.004 Sep 30 09:57:16.633602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:16.636286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:591 - port information retrieved. Elapsed:0.009 Sep 30 09:57:16.636617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:591 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:57:18.628712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:592 started Sep 30 09:57:18.631811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06be,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=131000000,duration_sec=1197,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:18.632384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:18.632739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:592 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:57:20.629717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:593 started Sep 30 09:57:20.632829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06c0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=132000000,duration_sec=1199,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:20.633393 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:20.633742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:593 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:57:22.630355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:594 started Sep 30 09:57:22.633367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06c2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=133000000,duration_sec=1201,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:22.633933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:22.634285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:594 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:57:24.631852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:595 started Sep 30 09:57:24.634956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=134000000,duration_sec=1203,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:24.635518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:24.635862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:595 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:57:26.633107 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:596 started Sep 30 09:57:26.635454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06c6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=135000000,duration_sec=1205,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:26.636041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:26.636471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:596 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:57:28.634521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:597 started Sep 30 09:57:28.636928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=137000000,duration_sec=1207,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:28.637497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:28.637851 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:597 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:57:30.636729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:598 started Sep 30 09:57:30.639453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=139000000,duration_sec=1209,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:30.640022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:30.640372 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:598 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:57:32.637525 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:599 started Sep 30 09:57:32.640376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=140000000,duration_sec=1211,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:32.640940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:32.641287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:599 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:57:33.210045 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8f390049-f097-4dcf-8d48-bf051430c317 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource Port deleted: 5fe64bf6-a448-427d-8a92-4b647a91c107 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:33.210419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8f390049-f097-4dcf-8d48-bf051430c317 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (5fe64bf6-a448-427d-8a92-4b647a91c107), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:33.218729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8f390049-f097-4dcf-8d48-bf051430c317 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group member updated {'c5fe62fb-9dbb-448f-becd-597b2be6c5d3'} Sep 30 09:57:34.638903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:600 started Sep 30 09:57:34.641640 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=142000000,duration_sec=1213,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:34.642394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:34.642760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:600 - starting polling. Elapsed:0.004 Sep 30 09:57:34.644773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:34.646154 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 5fe64bf6-a448-427d-8a92-4b647a91c107 not present in bridge br-int Sep 30 09:57:34.646475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:57:34.646771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['5fe64bf6-a448-427d-8a92-4b647a91c107'] Sep 30 09:57:34.647089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 5fe64bf6-a448-427d-8a92-4b647a91c107 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:57:34.649763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:600 - port information retrieved. Elapsed:0.011 Sep 30 09:57:34.650102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:600 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:57:36.639667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:601 started Sep 30 09:57:36.642233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=142000000,duration_sec=1215,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:36.643091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:36.643437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:601 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:57:36.891580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource SecurityGroup deleted: c5fe62fb-9dbb-448f-becd-597b2be6c5d3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:36.895792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (c5fe62fb-9dbb-448f-becd-597b2be6c5d3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:36.895792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c5fe62fb-9dbb-448f-becd-597b2be6c5d3',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:57:36.906134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c5fe62fb-9dbb-448f-becd-597b2be6c5d3',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:57:36.906798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource SecurityGroupRule deleted: 37f04d82-89de-4711-8f9d-75db493f1974 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:36.907171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (37f04d82-89de-4711-8f9d-75db493f1974), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:36.907507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['c5fe62fb-9dbb-448f-becd-597b2be6c5d3'] Sep 30 09:57:36.907895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource SecurityGroupRule deleted: 4b419b6a-16f2-49b4-9355-1b6cd11dbff5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:36.908242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4b419b6a-16f2-49b4-9355-1b6cd11dbff5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:36.908562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['c5fe62fb-9dbb-448f-becd-597b2be6c5d3'] Sep 30 09:57:36.908929 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource SecurityGroupRule deleted: 041b435d-3203-438a-83e3-b76363275329 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:36.909266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (041b435d-3203-438a-83e3-b76363275329), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:36.909603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['c5fe62fb-9dbb-448f-becd-597b2be6c5d3'] Sep 30 09:57:36.909965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource SecurityGroupRule deleted: 1876d655-b786-4e0a-a6b8-f885aafc9b6a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:36.910298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (1876d655-b786-4e0a-a6b8-f885aafc9b6a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:36.910633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-515eb301-a676-4f35-8102-8930205ed631 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Security group rule updated ['c5fe62fb-9dbb-448f-becd-597b2be6c5d3'] Sep 30 09:57:37.315554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-20891f38-7d59-47f8-8ee3-696047b6e416 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Resource Port deleted: 33cb1e4a-672a-4375-a3e6-deab9334cdf9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:37.315980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-20891f38-7d59-47f8-8ee3-696047b6e416 tempest-AttachVolumeShelveTestJSON-1331107251 tempest-AttachVolumeShelveTestJSON-1331107251-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (33cb1e4a-672a-4375-a3e6-deab9334cdf9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:38.640839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:602 started Sep 30 09:57:38.643235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=143000000,duration_sec=1217,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:38.644193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:38.644521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:602 - starting polling. Elapsed:0.004 Sep 30 09:57:38.646556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:38.647980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 33cb1e4a-672a-4375-a3e6-deab9334cdf9 not present in bridge br-int Sep 30 09:57:38.648301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:57:38.648578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['33cb1e4a-672a-4375-a3e6-deab9334cdf9'] Sep 30 09:57:38.648886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 33cb1e4a-672a-4375-a3e6-deab9334cdf9 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:57:38.651415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:602 - port information retrieved. Elapsed:0.011 Sep 30 09:57:38.651740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:602 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:57:40.642231 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:603 started Sep 30 09:57:40.644597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=144000000,duration_sec=1219,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:40.645536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:40.645905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:603 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:57:41.188078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a184bab6-a62d-4b08-9d7d-3c751f6ba5c6 admin admin] Resource Port deleted: 6b2eeaac-b65e-4315-9e6b-2f3f7f643e90 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:41.188456 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a184bab6-a62d-4b08-9d7d-3c751f6ba5c6 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (6b2eeaac-b65e-4315-9e6b-2f3f7f643e90), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:42.154135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["bff25f27-3c9d-4090-927c-ea6afd163d51","delete","qr-6b2eeaac-b6",35,["map",[["attached-mac","fa:16:3e:38:23:ec"],["iface-id","6b2eeaac-b65e-4315-9e6b-2f3f7f643e90"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:57:42.383173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cbd12a6c-1953-4b89-9651-e9e975cde0ba admin admin] Resource Port deleted: 419b6762-0832-495f-98ee-a4ec35979ac6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:42.383771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cbd12a6c-1953-4b89-9651-e9e975cde0ba admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (419b6762-0832-495f-98ee-a4ec35979ac6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:42.561522 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["47300bb6-ad2e-49be-ba47-5e21fb9643d0","delete","qg-419b6762-08",34,["map",[["attached-mac","fa:16:3e:89:a2:e6"],["iface-id","419b6762-0832-495f-98ee-a4ec35979ac6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:57:42.643405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:604 started Sep 30 09:57:42.851793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=349000000,duration_sec=1221,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:42.852993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:42.853643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:604 - starting polling. Elapsed:0.210 Sep 30 09:57:42.855531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:42.859671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c06d8,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 34}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:42.861853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c06da,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 35}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:42.869409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:604 - port information retrieved. Elapsed:0.219 Sep 30 09:57:42.869409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'b7a27b78-a40e-4f25-8170-bf802b8d0bf6', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'6b2eeaac-b65e-4315-9e6b-2f3f7f643e90', '419b6762-0832-495f-98ee-a4ec35979ac6'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:57:42.869409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:604 - agent port security group processed in 0.000 Sep 30 09:57:42.869409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:57:42.869409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'6b2eeaac-b65e-4315-9e6b-2f3f7f643e90', '419b6762-0832-495f-98ee-a4ec35979ac6'} Sep 30 09:57:42.869940 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 8 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:57:42.904080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[a281f8e6-72e6-4ba0-9916-8f33ba185db8]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:57:42.905541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'6b2eeaac-b65e-4315-9e6b-2f3f7f643e90', '419b6762-0832-495f-98ee-a4ec35979ac6'} removed Sep 30 09:57:42.955380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:57:42.956377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:604 - treat_devices_removed completed in 0.091 Sep 30 09:57:42.956377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:604 - ports processed. Elapsed:0.313 Sep 30 09:57:42.956587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:604 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.313 Sep 30 09:57:42.978176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4886d385-a7eb-4e9a-b753-74a27b52f8dc admin admin] Resource Subnet deleted: 33641e3b-dbf8-48b8-92c8-d70b8e4cb83e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:42.984822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4886d385-a7eb-4e9a-b753-74a27b52f8dc admin admin] Publish callbacks [] for Subnet (33641e3b-dbf8-48b8-92c8-d70b8e4cb83e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:43.123392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["ffbb9e47-b2b1-44b4-9acc-6a6f3b7de0b2","delete","tapb7a27b78-a4",33,["map",[["attached-mac","fa:16:3e:83:29:51"],["iface-id","b7a27b78-a40e-4f25-8170-bf802b8d0bf6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:57:43.389039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-664d86e5-1839-4629-8b06-21968152d4ee admin admin] Resource Port deleted: b7a27b78-a40e-4f25-8170-bf802b8d0bf6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:43.389711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-664d86e5-1839-4629-8b06-21968152d4ee admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (b7a27b78-a40e-4f25-8170-bf802b8d0bf6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:43.401665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-05bf0aba-a313-43ca-8fdc-a56cbe1c7697 None None] Resource Port deleted: b7a27b78-a40e-4f25-8170-bf802b8d0bf6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:43.402322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-05bf0aba-a313-43ca-8fdc-a56cbe1c7697 None None] Skipped duplicate delete event for b7a27b78-a40e-4f25-8170-bf802b8d0bf6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 30 09:57:43.659310 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-664d86e5-1839-4629-8b06-21968152d4ee admin admin] Resource Network deleted: 6555801d-cf6b-484f-a48c-039d4395e1ca {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:43.659755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-664d86e5-1839-4629-8b06-21968152d4ee admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (6555801d-cf6b-484f-a48c-039d4395e1ca), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:44.238758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Resource SecurityGroup deleted: fb29bb3c-19ab-4439-8e3f-58ed6b5990aa {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:44.239206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (fb29bb3c-19ab-4439-8e3f-58ed6b5990aa), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:44.239799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('fb29bb3c-19ab-4439-8e3f-58ed6b5990aa',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:57:44.253396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('fb29bb3c-19ab-4439-8e3f-58ed6b5990aa',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:57:44.253838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Resource SecurityGroupRule deleted: 27cc4b53-7cfe-4dc3-a46a-c3a3d32c7fa4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:44.254204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (27cc4b53-7cfe-4dc3-a46a-c3a3d32c7fa4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:44.254578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Security group rule updated ['fb29bb3c-19ab-4439-8e3f-58ed6b5990aa'] Sep 30 09:57:44.254995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Resource SecurityGroupRule deleted: 340ce3ba-7e28-451a-80a0-4b2246cc1e48 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:44.255529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (340ce3ba-7e28-451a-80a0-4b2246cc1e48), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:44.255845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Security group rule updated ['fb29bb3c-19ab-4439-8e3f-58ed6b5990aa'] Sep 30 09:57:44.256236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Resource SecurityGroupRule deleted: 4c971e56-60bd-43b5-823f-f6be64dfc372 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:44.256826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (4c971e56-60bd-43b5-823f-f6be64dfc372), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:44.257138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Security group rule updated ['fb29bb3c-19ab-4439-8e3f-58ed6b5990aa'] Sep 30 09:57:44.257526 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Resource SecurityGroupRule deleted: d2f16c4c-481d-4963-b725-f92ef97a3072 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:57:44.257860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d2f16c4c-481d-4963-b725-f92ef97a3072), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:44.258167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-44381aa5-92c8-4af2-957a-d38ea4e628b3 admin admin] Security group rule updated ['fb29bb3c-19ab-4439-8e3f-58ed6b5990aa'] Sep 30 09:57:44.644001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:605 started Sep 30 09:57:44.646453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=146000000,duration_sec=1223,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:44.647593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:44.648001 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:605 - starting polling. Elapsed:0.004 Sep 30 09:57:44.653681 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:44.654503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c06de,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 33}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:44.654753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:605 - port information retrieved. Elapsed:0.011 Sep 30 09:57:44.655082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '56479e13-743f-48e1-a33c-f8888b22c96a', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'b7a27b78-a40e-4f25-8170-bf802b8d0bf6'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:57:44.655396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:605 - agent port security group processed in 0.000 Sep 30 09:57:44.657080 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:57:44.657408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'b7a27b78-a40e-4f25-8170-bf802b8d0bf6'} Sep 30 09:57:44.657796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:57:44.693445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e26595-2c0f-45cd-9974-d502e6106a09]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:57:44.694364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'b7a27b78-a40e-4f25-8170-bf802b8d0bf6'} removed Sep 30 09:57:44.724713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:57:44.725145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Reclaiming vlan = 13 from net-id = 6555801d-cf6b-484f-a48c-039d4395e1ca, seg-id = 391 Sep 30 09:57:44.730961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xc9105f0c,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16864421859504038737,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4109}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:44.733194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xf1c06e0,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4487}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:44.736014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:605 - treat_devices_removed completed in 0.076 Sep 30 09:57:44.736014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:605 - ports processed. Elapsed:0.090 Sep 30 09:57:44.736014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:605 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.090 Sep 30 09:57:45.533322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:57:45Z,description='Default security group',id=cb235bf8-827b-4eff-b017-d7559402eaee,is_default=True,name='default',project_id='85eef8fd790146cfa7da6214c13ca262',revision_number=1,rules=[SecurityGroupRule(08c9ecc2-21e6-4069-9cf8-129fa7e7ef52),SecurityGroupRule(42d83edc-2226-4a66-b747-8952b3160a5c),SecurityGroupRule(b167ffa5-4024-4f92-849b-cdc9d622d34c),SecurityGroupRule(e99b7954-c95e-4257-9b85-2187c1d9da56)],shared=False,stateful=True,updated_at=2022-09-30T09:57:45Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:45.533322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (cb235bf8-827b-4eff-b017-d7559402eaee), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:45.533540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:57:45Z,description=,direction='egress',ethertype='IPv4',id=08c9ecc2-21e6-4069-9cf8-129fa7e7ef52,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eef8fd790146cfa7da6214c13ca262',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cb235bf8-827b-4eff-b017-d7559402eaee,updated_at=2022-09-30T09:57:45Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:45.533740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (08c9ecc2-21e6-4069-9cf8-129fa7e7ef52), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:45.534106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Security group rule updated ['cb235bf8-827b-4eff-b017-d7559402eaee'] Sep 30 09:57:45.534849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:57:45Z,description=,direction='ingress',ethertype='IPv4',id=42d83edc-2226-4a66-b747-8952b3160a5c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eef8fd790146cfa7da6214c13ca262',protocol=,remote_address_group_id=,remote_group_id=cb235bf8-827b-4eff-b017-d7559402eaee,remote_ip_prefix=,revision_number=0,security_group_id=cb235bf8-827b-4eff-b017-d7559402eaee,updated_at=2022-09-30T09:57:45Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:45.535203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (42d83edc-2226-4a66-b747-8952b3160a5c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:45.535529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Security group rule updated ['cb235bf8-827b-4eff-b017-d7559402eaee'] Sep 30 09:57:45.536189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:57:45Z,description=,direction='ingress',ethertype='IPv6',id=b167ffa5-4024-4f92-849b-cdc9d622d34c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eef8fd790146cfa7da6214c13ca262',protocol=,remote_address_group_id=,remote_group_id=cb235bf8-827b-4eff-b017-d7559402eaee,remote_ip_prefix=,revision_number=0,security_group_id=cb235bf8-827b-4eff-b017-d7559402eaee,updated_at=2022-09-30T09:57:45Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:45.536545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (b167ffa5-4024-4f92-849b-cdc9d622d34c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:45.536870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Security group rule updated ['cb235bf8-827b-4eff-b017-d7559402eaee'] Sep 30 09:57:45.537556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:57:45Z,description=,direction='egress',ethertype='IPv6',id=e99b7954-c95e-4257-9b85-2187c1d9da56,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eef8fd790146cfa7da6214c13ca262',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=cb235bf8-827b-4eff-b017-d7559402eaee,updated_at=2022-09-30T09:57:45Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:45.537903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e99b7954-c95e-4257-9b85-2187c1d9da56), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:45.538227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Security group rule updated ['cb235bf8-827b-4eff-b017-d7559402eaee'] Sep 30 09:57:45.741497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Received new resource Network: Network(admin_state_up=True,availability_zone_hints=,created_at=2022-09-30T09:57:45Z,description='',dns_domain=None,id=6c765eee-bae8-4b34-897a-abb29acd5a27,mtu=1500,name='tempest-AttachVolumeTestJSON-155296826-network',project_id='85eef8fd790146cfa7da6214c13ca262',qos_policy_id=None,revision_number=1,security=NetworkPortSecurity(6c765eee-bae8-4b34-897a-abb29acd5a27),segments=[NetworkSegment(46a05691-a9f7-44f4-88e8-053c7fa824e0)],shared=False,status='ACTIVE',updated_at=2022-09-30T09:57:45Z,vlan_transparent=) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:45.742104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (6c765eee-bae8-4b34-897a-abb29acd5a27), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:45.810727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager [None req-4a216a2b-dbb1-4f5a-903e-2567c94d7428 admin admin] Error during notification for neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384 Network, after_update: neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 6c765eee-bae8-4b34-897a-abb29acd5a27 with segmentation id not found. Sep 30 09:57:45.810727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last): Sep 30 09:57:45.810727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Sep 30 09:57:45.810727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager callback(resource, event, trigger, payload=payload) Sep 30 09:57:45.810727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/agent/rpc.py", line 270, in _legacy_notifier Sep 30 09:57:45.810727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager getattr(self._legacy_interface, method)(context, **payload) Sep 30 09:57:45.810727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/usr/local/lib/python3.8/dist-packages/osprofiler/profiler.py", line 159, in wrapper Sep 30 09:57:45.810727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager result = f(*args, **kwargs) Sep 30 09:57:45.810727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 686, in network_update Sep 30 09:57:45.810727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self._update_network_segmentation_id(network) Sep 30 09:57:45.810727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 498, in _update_network_segmentation_id Sep 30 09:57:45.810727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager self.vlan_manager.update_segmentation_id( Sep 30 09:57:45.810727 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 135, in update_segmentation_id Sep 30 09:57:45.811915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager if len(self.get_segments(net_id)) != 1: Sep 30 09:57:45.811915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager File "/opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/vlanmanager.py", line 121, in get_segments Sep 30 09:57:45.811915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager raise MappingNotFound(net_id=net_id, seg_id="") Sep 30 09:57:45.811915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager neutron.plugins.ml2.drivers.openvswitch.agent.vlanmanager.MappingNotFound: Mapping VLAN for network 6c765eee-bae8-4b34-897a-abb29acd5a27 with segmentation id not found. Sep 30 09:57:45.811915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: ERROR neutron_lib.callbacks.manager Sep 30 09:57:46.214755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-88682a70-ae95-4e71-b425-7ac7e9c6ba29 admin admin] Received new resource Subnet: Subnet(allocation_pools=[IPAllocationPool(7e3b6b39-71a5-48b8-859f-cc84775cde65)],cidr=172.20.0.0/28,created_at=2022-09-30T09:57:46Z,description='',dns_nameservers=[],dns_publish_fixed_ip=False,enable_dhcp=True,gateway_ip=172.20.0.1,host_routes=[],id=cdfb3e22-5a9f-46a0-8aac-da19c4e3d178,ip_version=4,ipv6_address_mode=,ipv6_ra_mode=,name='tempest-AttachVolumeTestJSON-155296826-subnet',network_id=6c765eee-bae8-4b34-897a-abb29acd5a27,project_id='85eef8fd790146cfa7da6214c13ca262',revision_number=0,segment_id=,service_types=[],shared=False,subnetpool_id=,updated_at=2022-09-30T09:57:46Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:46.215775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-88682a70-ae95-4e71-b425-7ac7e9c6ba29 admin admin] Publish callbacks [] for Subnet (cdfb3e22-5a9f-46a0-8aac-da19c4e3d178), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:46.645132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:606 started Sep 30 09:57:46.648168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=147000000,duration_sec=1225,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:46.649052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:46.649413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:606 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:57:46.952796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ecfc7231-da6e-4fbc-9323-0f80aa8b3ea8 None None] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:57:46Z,data_plane_status=None,description='',device_id='dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6c765eee-bae8-4b34-897a-abb29acd5a27',device_owner='network:dhcp',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=476f0e98-0f2c-4e96-9e9d-e51e538823f1,mac_address=fa:16:3e:15:71:84,name='',network_id=6c765eee-bae8-4b34-897a-abb29acd5a27,numa_affinity_policy=,project_id='85eef8fd790146cfa7da6214c13ca262',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(476f0e98-0f2c-4e96-9e9d-e51e538823f1),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:57:46Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:46.953955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ecfc7231-da6e-4fbc-9323-0f80aa8b3ea8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (476f0e98-0f2c-4e96-9e9d-e51e538823f1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:47.237450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ecfc7231-da6e-4fbc-9323-0f80aa8b3ea8 None None] Resource Port 476f0e98-0f2c-4e96-9e9d-e51e538823f1 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=476f0e98-0f2c-4e96-9e9d-e51e538823f1,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=476f0e98-0f2c-4e96-9e9d-e51e538823f1,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=476f0e98-0f2c-4e96-9e9d-e51e538823f1,segment=NetworkSegment(46a05691-a9f7-44f4-88e8-053c7fa824e0),segment_id=46a05691-a9f7-44f4-88e8-053c7fa824e0)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:47.237827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ecfc7231-da6e-4fbc-9323-0f80aa8b3ea8 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (476f0e98-0f2c-4e96-9e9d-e51e538823f1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:47.328976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6dff4e8c-c06e-4d5e-91cb-1e40f7140d49","insert","tap476f0e98-0f",["set",[]],["map",[["attached-mac","fa:16:3e:15:71:84"],["iface-id","476f0e98-0f2c-4e96-9e9d-e51e538823f1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:57:47.347742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6dff4e8c-c06e-4d5e-91cb-1e40f7140d49","old",null,["set",[]],null],["","new","tap476f0e98-0f",36,["map",[["attached-mac","fa:16:3e:15:71:84"],["iface-id","476f0e98-0f2c-4e96-9e9d-e51e538823f1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:57:47.535936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a89b3c0b-81a4-4659-9a5d-0e9b060f5a8e admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:57:47Z,data_plane_status=None,description='',device_id='a7292184-b277-423e-aad0-6cbd01679528',device_owner='network:router_gateway',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=beeb0a48-a86c-43a4-9603-e4b77a8d536b,mac_address=fa:16:3e:26:9c:49,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(beeb0a48-a86c-43a4-9603-e4b77a8d536b),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:57:47Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:47.536282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a89b3c0b-81a4-4659-9a5d-0e9b060f5a8e admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (beeb0a48-a86c-43a4-9603-e4b77a8d536b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:48.481730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-cb153ea3-98e4-43de-969f-b6c888c1e3f7 None None] Resource Port 476f0e98-0f2c-4e96-9e9d-e51e538823f1 updated (revision_number 2->3). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:48.482308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-cb153ea3-98e4-43de-969f-b6c888c1e3f7 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (476f0e98-0f2c-4e96-9e9d-e51e538823f1), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:48.645555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:607 started Sep 30 09:57:48.647998 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=148000000,duration_sec=1227,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:48.648619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:48.649073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:607 - starting polling. Elapsed:0.004 Sep 30 09:57:48.650953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:48.653813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:607 - port information retrieved. Elapsed:0.008 Sep 30 09:57:48.654134 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'fbf021f9-ae35-47af-9243-953bba459691', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '476f0e98-0f2c-4e96-9e9d-e51e538823f1', '56479e13-743f-48e1-a33c-f8888b22c96a', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': {'476f0e98-0f2c-4e96-9e9d-e51e538823f1'}, 'removed': set(), 'updated': {'476f0e98-0f2c-4e96-9e9d-e51e538823f1'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:57:48.654707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '476f0e98-0f2c-4e96-9e9d-e51e538823f1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6c765eee-bae8-4b34-897a-abb29acd5a27', 'network_id': '6c765eee-bae8-4b34-897a-abb29acd5a27', 'port_id': '476f0e98-0f2c-4e96-9e9d-e51e538823f1', 'mac_address': 'fa:16:3e:15:71:84', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cdfb3e22-5a9f-46a0-8aac-da19c4e3d178', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:57:48.657186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 476f0e98-0f2c-4e96-9e9d-e51e538823f1 {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:57:48.657524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 476f0e98-0f2c-4e96-9e9d-e51e538823f1 updated. Details: {'device': '476f0e98-0f2c-4e96-9e9d-e51e538823f1', 'device_id': 'dhcpb3c3bfec-14a5-5c37-87fb-dceca947527c-6c765eee-bae8-4b34-897a-abb29acd5a27', 'network_id': '6c765eee-bae8-4b34-897a-abb29acd5a27', 'port_id': '476f0e98-0f2c-4e96-9e9d-e51e538823f1', 'mac_address': 'fa:16:3e:15:71:84', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cdfb3e22-5a9f-46a0-8aac-da19c4e3d178', 'ip_address': '172.20.0.2'}], 'device_owner': 'network:dhcp', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': None} Sep 30 09:57:48.657852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Assigning 14 as local vlan for net-id=6c765eee-bae8-4b34-897a-abb29acd5a27, seg-id=389 Sep 30 09:57:48.660930 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x70,xid=0xc9105f0e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=16864421859504038737,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4485), OFPActionOutput(len=16,max_len=0,port=4294967290,type=0)],len=40,type=4)],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=0,out_port=0,priority=4,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:48.664212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x68,xid=0xf1c06e6,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[OFPInstructionActions(actions=[OFPActionSetField(vlan_vid=4110)],len=24,type=4), OFPInstructionGotoTable(len=8,table_id=59,type=1)],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4485}),out_group=0,out_port=0,priority=3,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:48.664837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap476f0e98-0f, col_values=(('tag', 14),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:48.665273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=tap476f0e98-0f, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:48.665698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=tap476f0e98-0f, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:48.672778 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=tap476f0e98-0f, col_values=(('other_config', {'net_uuid': '6c765eee-bae8-4b34-897a-abb29acd5a27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '389'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:48.683750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c06e8,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:48.684535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:607 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 11 devices currently available. Time elapsed: 0.030 Sep 30 09:57:48.686791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:57:48.686791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'476f0e98-0f2c-4e96-9e9d-e51e538823f1'} Sep 30 09:57:48.687911 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:57:48.688542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:57:48.692226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:57:48.750968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[551d73c9-17fe-487d-a863-f775cc270d50]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:57:48.751712 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:607 - agent port security group processed in 0.097 Sep 30 09:57:48.752498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 476f0e98-0f2c-4e96-9e9d-e51e538823f1 to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:57:49.185387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['476f0e98-0f2c-4e96-9e9d-e51e538823f1'] and devices down [] completed. Sep 30 09:57:49.185750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:607 - ports processed. Elapsed:0.540 Sep 30 09:57:49.186256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:607 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.541 Sep 30 09:57:49.501997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d28a0028-9935-4943-8bb2-29b0f4ce7b74 admin admin] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:57:49Z,data_plane_status=None,description='',device_id='a7292184-b277-423e-aad0-6cbd01679528',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=54c4d0b4-c612-4724-9902-f7424400906b,mac_address=fa:16:3e:fb:25:90,name='',network_id=6c765eee-bae8-4b34-897a-abb29acd5a27,numa_affinity_policy=,project_id='85eef8fd790146cfa7da6214c13ca262',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(54c4d0b4-c612-4724-9902-f7424400906b),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:57:49Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:49.502638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d28a0028-9935-4943-8bb2-29b0f4ce7b74 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (54c4d0b4-c612-4724-9902-f7424400906b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:49.562263 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2f4a0e8a-1bd5-4ca9-82cd-5c4213bdc0fc None None] Resource Port beeb0a48-a86c-43a4-9603-e4b77a8d536b updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=beeb0a48-a86c-43a4-9603-e4b77a8d536b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=beeb0a48-a86c-43a4-9603-e4b77a8d536b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:49.562867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2f4a0e8a-1bd5-4ca9-82cd-5c4213bdc0fc None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (beeb0a48-a86c-43a4-9603-e4b77a8d536b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:49.878754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2f4a0e8a-1bd5-4ca9-82cd-5c4213bdc0fc None None] Resource Port beeb0a48-a86c-43a4-9603-e4b77a8d536b updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=beeb0a48-a86c-43a4-9603-e4b77a8d536b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=beeb0a48-a86c-43a4-9603-e4b77a8d536b,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=beeb0a48-a86c-43a4-9603-e4b77a8d536b,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:49.879302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2f4a0e8a-1bd5-4ca9-82cd-5c4213bdc0fc None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (beeb0a48-a86c-43a4-9603-e4b77a8d536b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:50.047988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d28a0028-9935-4943-8bb2-29b0f4ce7b74 admin admin] Received resource Port update without any changes: 54c4d0b4-c612-4724-9902-f7424400906b {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:184}} Sep 30 09:57:50.346692 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5cfcf47a-45c5-4060-adac-e14526cb66be","insert","qr-54c4d0b4-c6",["set",[]],["map",[["attached-mac","fa:16:3e:fb:25:90"],["iface-id","54c4d0b4-c612-4724-9902-f7424400906b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:57:50.360756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5cfcf47a-45c5-4060-adac-e14526cb66be","old",null,["set",[]],null],["","new","qr-54c4d0b4-c6",37,["map",[["attached-mac","fa:16:3e:fb:25:90"],["iface-id","54c4d0b4-c612-4724-9902-f7424400906b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:57:50.647094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:608 started Sep 30 09:57:50.649562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=149000000,duration_sec=1229,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:50.650341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:50.651042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:608 - starting polling. Elapsed:0.004 Sep 30 09:57:50.653840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:50.656377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:608 - port information retrieved. Elapsed:0.010 Sep 30 09:57:50.656707 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'fbf021f9-ae35-47af-9243-953bba459691', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', '54c4d0b4-c612-4724-9902-f7424400906b', '0a907ef6-0733-4f96-9909-bd47d7e38800', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '452383da-1307-41b6-9960-d5a92f51b39f', '476f0e98-0f2c-4e96-9e9d-e51e538823f1', '56479e13-743f-48e1-a33c-f8888b22c96a', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': {'54c4d0b4-c612-4724-9902-f7424400906b'}, 'removed': set(), 'updated': {'54c4d0b4-c612-4724-9902-f7424400906b'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:57:50.657363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: WARNING neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Device Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:57:49Z,data_plane_status=None,description='',device_id='a7292184-b277-423e-aad0-6cbd01679528',device_owner='network:router_interface',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=54c4d0b4-c612-4724-9902-f7424400906b,mac_address=fa:16:3e:fb:25:90,name='',network_id=6c765eee-bae8-4b34-897a-abb29acd5a27,numa_affinity_policy=,project_id='85eef8fd790146cfa7da6214c13ca262',qos_network_policy_id=None,qos_policy_id=None,revision_number=2,security=PortSecurity(54c4d0b4-c612-4724-9902-f7424400906b),security_group_ids=set([]),status='DOWN',updated_at=2022-09-30T09:57:49Z) is not bound. Sep 30 09:57:50.659944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 54c4d0b4-c612-4724-9902-f7424400906b {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:57:50.660449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: WARNING neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Device 54c4d0b4-c612-4724-9902-f7424400906b not defined on plugin or binding failed Sep 30 09:57:50.661085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:608 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 12 devices currently available. Time elapsed: 0.004 Sep 30 09:57:50.661553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:57:50.662021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'54c4d0b4-c612-4724-9902-f7424400906b'} Sep 30 09:57:50.663003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:57:50.663279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:57:50.666982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:608 - agent port security group processed in 0.010 Sep 30 09:57:50.669849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:57:50.670363 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:608 - ports processed. Elapsed:0.024 Sep 30 09:57:50.670903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:608 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 1, 'removed': 0}}. Elapsed:0.024 Sep 30 09:57:50.797228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["44f4ce06-858c-4a00-b434-58aeb76a3fea","insert","qg-beeb0a48-a8",["set",[]],["map",[["attached-mac","fa:16:3e:26:9c:49"],["iface-id","beeb0a48-a86c-43a4-9603-e4b77a8d536b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:57:50.819373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["44f4ce06-858c-4a00-b434-58aeb76a3fea","old",null,["set",[]],null],["","new","qg-beeb0a48-a8",38,["map",[["attached-mac","fa:16:3e:26:9c:49"],["iface-id","beeb0a48-a86c-43a4-9603-e4b77a8d536b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:57:51.076106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-74bfd2c8-3d38-4806-a5e8-221f0f68abf7 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T09:57:50Z,description='tempest-description--1096333193',id=147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f,is_default=False,name='tempest-securitygroup--868858801',project_id='85eef8fd790146cfa7da6214c13ca262',revision_number=1,rules=[SecurityGroupRule(093a3eff-edbc-4313-b75c-c5cb8db79dcc),SecurityGroupRule(d81049d6-6357-48d0-b1ae-0e88c12f5980)],shared=False,stateful=True,updated_at=2022-09-30T09:57:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:51.076485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-74bfd2c8-3d38-4806-a5e8-221f0f68abf7 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:51.077111 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-74bfd2c8-3d38-4806-a5e8-221f0f68abf7 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:57:50Z,description=,direction='egress',ethertype='IPv6',id=093a3eff-edbc-4313-b75c-c5cb8db79dcc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eef8fd790146cfa7da6214c13ca262',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f,updated_at=2022-09-30T09:57:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:51.077474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-74bfd2c8-3d38-4806-a5e8-221f0f68abf7 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (093a3eff-edbc-4313-b75c-c5cb8db79dcc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:51.077816 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-74bfd2c8-3d38-4806-a5e8-221f0f68abf7 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f'] Sep 30 09:57:51.078492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-74bfd2c8-3d38-4806-a5e8-221f0f68abf7 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:57:50Z,description=,direction='egress',ethertype='IPv4',id=d81049d6-6357-48d0-b1ae-0e88c12f5980,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eef8fd790146cfa7da6214c13ca262',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f,updated_at=2022-09-30T09:57:50Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:51.078873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-74bfd2c8-3d38-4806-a5e8-221f0f68abf7 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d81049d6-6357-48d0-b1ae-0e88c12f5980), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:51.079203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-74bfd2c8-3d38-4806-a5e8-221f0f68abf7 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f'] Sep 30 09:57:51.419010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1c176f19-b11a-47b6-92de-b63fe4e3f48e tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:57:51Z,description='',direction='ingress',ethertype='IPv4',id=8050062d-77ef-4295-913d-a3075153322b,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='85eef8fd790146cfa7da6214c13ca262',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f,updated_at=2022-09-30T09:57:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:51.419317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1c176f19-b11a-47b6-92de-b63fe4e3f48e tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8050062d-77ef-4295-913d-a3075153322b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:51.419686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1c176f19-b11a-47b6-92de-b63fe4e3f48e tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f'] Sep 30 09:57:51.764238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4bbb4055-f9f2-4203-92d8-4c07701c3afe tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T09:57:51Z,description='',direction='ingress',ethertype='IPv4',id=80dddb3f-60e8-4213-b9b2-67d86e622c1c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eef8fd790146cfa7da6214c13ca262',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f,updated_at=2022-09-30T09:57:51Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:51.765445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4bbb4055-f9f2-4203-92d8-4c07701c3afe tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (80dddb3f-60e8-4213-b9b2-67d86e622c1c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:51.765789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-4bbb4055-f9f2-4203-92d8-4c07701c3afe tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f'] Sep 30 09:57:52.394312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0925b091-1560-4f55-af7a-20f836e2348c tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:57:52Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=24dfc452-1f4b-4e9f-a7d4-2210935e8eb3,mac_address=fa:16:3e:36:6b:33,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(24dfc452-1f4b-4e9f-a7d4-2210935e8eb3),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T09:57:52Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:52.394799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0925b091-1560-4f55-af7a-20f836e2348c tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (24dfc452-1f4b-4e9f-a7d4-2210935e8eb3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:52.648103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:609 started Sep 30 09:57:52.651226 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=151000000,duration_sec=1231,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:52.651813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:52.652837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:609 - starting polling. Elapsed:0.004 Sep 30 09:57:52.655328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:52.658464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:609 - port information retrieved. Elapsed:0.011 Sep 30 09:57:52.658891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'fbf021f9-ae35-47af-9243-953bba459691', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'beeb0a48-a86c-43a4-9603-e4b77a8d536b', '54c4d0b4-c612-4724-9902-f7424400906b', '0a907ef6-0733-4f96-9909-bd47d7e38800', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '452383da-1307-41b6-9960-d5a92f51b39f', '476f0e98-0f2c-4e96-9e9d-e51e538823f1', '56479e13-743f-48e1-a33c-f8888b22c96a', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': {'beeb0a48-a86c-43a4-9603-e4b77a8d536b'}, 'removed': set(), 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:57:52.659550 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'beeb0a48-a86c-43a4-9603-e4b77a8d536b', 'device_id': 'a7292184-b277-423e-aad0-6cbd01679528', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'beeb0a48-a86c-43a4-9603-e4b77a8d536b', 'mac_address': 'fa:16:3e:26:9c:49', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.25'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:57:52.662216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: beeb0a48-a86c-43a4-9603-e4b77a8d536b {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:57:52.662627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port beeb0a48-a86c-43a4-9603-e4b77a8d536b updated. Details: {'device': 'beeb0a48-a86c-43a4-9603-e4b77a8d536b', 'device_id': 'a7292184-b277-423e-aad0-6cbd01679528', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'beeb0a48-a86c-43a4-9603-e4b77a8d536b', 'mac_address': 'fa:16:3e:26:9c:49', 'admin_state_up': True, 'status': 'DOWN', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.25'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:57:52.663869 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-beeb0a48-a8, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:52.664362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-beeb0a48-a8, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:52.665027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-beeb0a48-a8, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:52.672819 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-beeb0a48-a8, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:52.682338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c06ee,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:52.683823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:609 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.023 Sep 30 09:57:52.683823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing device filters for 1 new devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:290}} Sep 30 09:57:52.683823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Preparing filters for devices {'beeb0a48-a86c-43a4-9603-e4b77a8d536b'} Sep 30 09:57:52.684659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:57:52.684943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:57:52.688291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 2 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:57:52.725151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a49d64e-bb1a-4a0a-9c2d-bb38ccc54ad3]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:57:52.725771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:609 - agent port security group processed in 0.067 Sep 30 09:57:52.726530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for beeb0a48-a86c-43a4-9603-e4b77a8d536b to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:57:52.865459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e116efd4-befc-4e9c-8f66-1a7dff009b1e None None] Resource Port 54c4d0b4-c612-4724-9902-f7424400906b updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='',port_id=54c4d0b4-c612-4724-9902-f7424400906b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=54c4d0b4-c612-4724-9902-f7424400906b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:52.866136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e116efd4-befc-4e9c-8f66-1a7dff009b1e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (54c4d0b4-c612-4724-9902-f7424400906b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:52.874268 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0925b091-1560-4f55-af7a-20f836e2348c tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource Port 24dfc452-1f4b-4e9f-a7d4-2210935e8eb3 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': '55302ca4-3dfc-4151-bdfd-cc412229a744'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:52.875301 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0925b091-1560-4f55-af7a-20f836e2348c tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (24dfc452-1f4b-4e9f-a7d4-2210935e8eb3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:52.962187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['beeb0a48-a86c-43a4-9603-e4b77a8d536b'] and devices down [] completed. Sep 30 09:57:52.962755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:609 - ports processed. Elapsed:0.315 Sep 30 09:57:52.968937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:609 completed. Processed ports statistics: {'regular': {'added': 1, 'updated': 0, 'removed': 0}}. Elapsed:0.315 Sep 30 09:57:53.018541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Resource Port beeb0a48-a86c-43a4-9603-e4b77a8d536b updated (revision_number 3->4). Old fields: {'status': 'DOWN', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=beeb0a48-a86c-43a4-9603-e4b77a8d536b,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} New fields: {'status': 'ACTIVE', 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=beeb0a48-a86c-43a4-9603-e4b77a8d536b,segment=NetworkSegment(c9c65e7a-b920-41dd-b960-210be8a11a19),segment_id=c9c65e7a-b920-41dd-b960-210be8a11a19)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:53.018954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3553b2c4-a215-4526-b771-8c565331667e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (beeb0a48-a86c-43a4-9603-e4b77a8d536b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:53.276850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e116efd4-befc-4e9c-8f66-1a7dff009b1e None None] Resource Port 54c4d0b4-c612-4724-9902-f7424400906b updated (revision_number 3->4). Old fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=54c4d0b4-c612-4724-9902-f7424400906b,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='dv-cinder-master-3-iscsi',port_id=54c4d0b4-c612-4724-9902-f7424400906b,profile={},status='ACTIVE',vif_details={"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"},vif_type='ovs',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='openvswitch',host='dv-cinder-master-3-iscsi',level=0,port_id=54c4d0b4-c612-4724-9902-f7424400906b,segment=NetworkSegment(46a05691-a9f7-44f4-88e8-053c7fa824e0),segment_id=46a05691-a9f7-44f4-88e8-053c7fa824e0)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:53.277360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e116efd4-befc-4e9c-8f66-1a7dff009b1e None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (54c4d0b4-c612-4724-9902-f7424400906b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:53.378280 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9a24c137-8f4d-4d9e-98f1-644cc2c6f070 None None] Resource Port 54c4d0b4-c612-4724-9902-f7424400906b updated (revision_number 4->5). Old fields: {'status': 'DOWN'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:53.378711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9a24c137-8f4d-4d9e-98f1-644cc2c6f070 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (54c4d0b4-c612-4724-9902-f7424400906b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:54.648966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:610 started Sep 30 09:57:54.651378 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=151000000,duration_sec=1233,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:54.651975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:54.652797 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:610 - starting polling. Elapsed:0.004 Sep 30 09:57:54.655020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:54.658931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:610 - port information retrieved. Elapsed:0.009 Sep 30 09:57:54.658931 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'fbf021f9-ae35-47af-9243-953bba459691', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'beeb0a48-a86c-43a4-9603-e4b77a8d536b', '54c4d0b4-c612-4724-9902-f7424400906b', '0a907ef6-0733-4f96-9909-bd47d7e38800', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '452383da-1307-41b6-9960-d5a92f51b39f', '476f0e98-0f2c-4e96-9e9d-e51e538823f1', '56479e13-743f-48e1-a33c-f8888b22c96a', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': set(), 'updated': {'54c4d0b4-c612-4724-9902-f7424400906b', 'beeb0a48-a86c-43a4-9603-e4b77a8d536b'}, 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:57:54.659162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': '54c4d0b4-c612-4724-9902-f7424400906b', 'device_id': 'a7292184-b277-423e-aad0-6cbd01679528', 'network_id': '6c765eee-bae8-4b34-897a-abb29acd5a27', 'port_id': '54c4d0b4-c612-4724-9902-f7424400906b', 'mac_address': 'fa:16:3e:fb:25:90', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cdfb3e22-5a9f-46a0-8aac-da19c4e3d178', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:57:54.659162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Returning: {'device': 'beeb0a48-a86c-43a4-9603-e4b77a8d536b', 'device_id': 'a7292184-b277-423e-aad0-6cbd01679528', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'beeb0a48-a86c-43a4-9603-e4b77a8d536b', 'mac_address': 'fa:16:3e:26:9c:49', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.25'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None} {{(pid=114230) get_device_details /opt/stack/neutron/neutron/agent/rpc.py:387}} Sep 30 09:57:54.661565 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: 54c4d0b4-c612-4724-9902-f7424400906b {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:57:54.661888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 54c4d0b4-c612-4724-9902-f7424400906b updated. Details: {'device': '54c4d0b4-c612-4724-9902-f7424400906b', 'device_id': 'a7292184-b277-423e-aad0-6cbd01679528', 'network_id': '6c765eee-bae8-4b34-897a-abb29acd5a27', 'port_id': '54c4d0b4-c612-4724-9902-f7424400906b', 'mac_address': 'fa:16:3e:fb:25:90', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'cdfb3e22-5a9f-46a0-8aac-da19c4e3d178', 'ip_address': '172.20.0.1'}], 'device_owner': 'network:router_interface', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 14} Sep 30 09:57:54.662843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-54c4d0b4-c6, col_values=(('tag', 14),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:54.663271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qr-54c4d0b4-c6, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:54.663703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qr-54c4d0b4-c6, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:54.669838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qr-54c4d0b4-c6, col_values=(('other_config', {'net_uuid': '6c765eee-bae8-4b34-897a-abb29acd5a27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'tag': '14', 'segmentation_id': '389'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:54.676079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c06f2,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:54.676409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing port: beeb0a48-a86c-43a4-9603-e4b77a8d536b {{(pid=114230) treat_devices_added_or_updated /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2001}} Sep 30 09:57:54.676835 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port beeb0a48-a86c-43a4-9603-e4b77a8d536b updated. Details: {'device': 'beeb0a48-a86c-43a4-9603-e4b77a8d536b', 'device_id': 'a7292184-b277-423e-aad0-6cbd01679528', 'network_id': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'port_id': 'beeb0a48-a86c-43a4-9603-e4b77a8d536b', 'mac_address': 'fa:16:3e:26:9c:49', 'admin_state_up': True, 'status': 'ACTIVE', 'network_type': 'flat', 'segmentation_id': None, 'physical_network': 'physnet1', 'fixed_ips': [{'subnet_id': 'd17ed916-ebf0-4a94-a3d0-5eb91b98323c', 'ip_address': '172.37.6.25'}], 'device_owner': 'network:router_gateway', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'qos_network_policy_id': None, 'profile': {}, 'vif_type': 'ovs', 'vnic_type': 'normal', 'security_groups': [], 'migrating_to': None, 'vif_port': , 'local_vlan': 2} Sep 30 09:57:54.677613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-beeb0a48-a8, col_values=(('tag', 2),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:54.678023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbClearCommand(table=Port, record=qg-beeb0a48-a8, column=vlan_mode) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:54.678436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbClearCommand(table=Port, record=qg-beeb0a48-a8, column=trunks) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:54.678895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:57:54.679617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-beeb0a48-a8, col_values=(('other_config', {'net_uuid': '357201ed-46d8-4a8e-b639-1f9bf08174d7', 'network_type': 'flat', 'physical_network': 'physnet1', 'tag': '2'}),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:57:54.680249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:141}} Sep 30 09:57:54.682245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c06f4,OFPFlowMod(buffer_id=4294967295,command=4,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:54.682570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:610 - treat_devices_added_or_updated completed. Skipped 0 and no activated binding devices 0 of 13 devices currently available. Time elapsed: 0.024 Sep 30 09:57:54.687657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refreshing firewall for 2 devices {{(pid=114230) setup_port_filters /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:301}} Sep 30 09:57:54.687657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Refresh firewall rules Sep 30 09:57:54.687657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information for ports dict_keys([]) {{(pid=114230) _apply_port_filter /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:173}} Sep 30 09:57:54.687657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Update security group information {{(pid=114230) _update_security_group_info /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:188}} Sep 30 09:57:54.689165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:57:54.725857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[2066118a-e567-4ed1-b2a7-6dbb4cb9d2aa]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:57:54.726542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:610 - agent port security group processed in 0.068 Sep 30 09:57:54.727474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for 54c4d0b4-c612-4724-9902-f7424400906b to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:57:54.727776 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Setting status for beeb0a48-a86c-43a4-9603-e4b77a8d536b to UP {{(pid=114230) _bind_devices /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:1265}} Sep 30 09:57:54.981290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up ['54c4d0b4-c612-4724-9902-f7424400906b', 'beeb0a48-a86c-43a4-9603-e4b77a8d536b'] and devices down [] completed. Sep 30 09:57:54.981803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:610 - ports processed. Elapsed:0.333 Sep 30 09:57:54.981935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:610 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 2, 'removed': 0}}. Elapsed:0.333 Sep 30 09:57:56.649645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:611 started Sep 30 09:57:56.652137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=152000000,duration_sec=1235,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:56.653243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:56.653677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:611 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:57:56.946552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-00783d73-ba67-44e5-8f87-f717c74de953 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T09:57:56Z,data_plane_status=None,description='',device_id='8872f2fa-9f26-40d0-b256-f8f31dd116e1',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=8354001a-2686-4424-85b3-eda11d52c3b4,mac_address=fa:16:3e:f0:2b:ed,name='',network_id=6c765eee-bae8-4b34-897a-abb29acd5a27,numa_affinity_policy=,project_id='85eef8fd790146cfa7da6214c13ca262',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(8354001a-2686-4424-85b3-eda11d52c3b4),security_group_ids=set([147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f]),status='DOWN',updated_at=2022-09-30T09:57:56Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 09:57:56.946552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-00783d73-ba67-44e5-8f87-f717c74de953 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (8354001a-2686-4424-85b3-eda11d52c3b4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:56.947129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-00783d73-ba67-44e5-8f87-f717c74de953 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group member updated {'147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f'} Sep 30 09:57:57.777731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ab42f1fe-cb36-499b-bb22-a33632beaeb2 service neutron] Resource Port 8354001a-2686-4424-85b3-eda11d52c3b4 updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=8354001a-2686-4424-85b3-eda11d52c3b4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=8354001a-2686-4424-85b3-eda11d52c3b4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:57.778362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ab42f1fe-cb36-499b-bb22-a33632beaeb2 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (8354001a-2686-4424-85b3-eda11d52c3b4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:58.093066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ab42f1fe-cb36-499b-bb22-a33632beaeb2 service neutron] Resource Port 8354001a-2686-4424-85b3-eda11d52c3b4 updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=8354001a-2686-4424-85b3-eda11d52c3b4,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=8354001a-2686-4424-85b3-eda11d52c3b4,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=8354001a-2686-4424-85b3-eda11d52c3b4,segment=NetworkSegment(46a05691-a9f7-44f4-88e8-053c7fa824e0),segment_id=46a05691-a9f7-44f4-88e8-053c7fa824e0)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:57:58.093478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ab42f1fe-cb36-499b-bb22-a33632beaeb2 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (8354001a-2686-4424-85b3-eda11d52c3b4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:58.650561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:612 started Sep 30 09:57:58.653011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06f8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=153000000,duration_sec=1237,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:57:58.653579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:57:58.653915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:612 - starting polling. Elapsed:0.004 Sep 30 09:57:58.656072 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:57:58.659013 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:612 - port information retrieved. Elapsed:0.009 Sep 30 09:57:58.659343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:612 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:58:00.651207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:613 started Sep 30 09:58:00.654200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06fa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=154000000,duration_sec=1239,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:00.654804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:00.655161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:613 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:02.652825 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:614 started Sep 30 09:58:02.659026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06fc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=155000000,duration_sec=1241,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:02.659612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:02.659968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:614 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 09:58:02.791679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 8354001a-2686-4424-85b3-eda11d52c3b4 updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:58:02.792051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (8354001a-2686-4424-85b3-eda11d52c3b4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:58:04.653503 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:615 started Sep 30 09:58:04.656240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c06fe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=156000000,duration_sec=1243,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:04.656808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:04.657142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:615 - starting polling. Elapsed:0.004 Sep 30 09:58:04.659204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:58:04.661792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:615 - port information retrieved. Elapsed:0.009 Sep 30 09:58:04.664683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:615 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:58:04.977404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 8354001a-2686-4424-85b3-eda11d52c3b4 updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 09:58:04.977856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (8354001a-2686-4424-85b3-eda11d52c3b4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:58:06.654584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:616 started Sep 30 09:58:06.657434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0700,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=157000000,duration_sec=1245,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:06.658003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:06.658338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:616 - starting polling. Elapsed:0.004 Sep 30 09:58:06.660476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:58:06.663090 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:616 - port information retrieved. Elapsed:0.009 Sep 30 09:58:06.663421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:616 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 09:58:08.655678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:617 started Sep 30 09:58:08.658445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0702,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=158000000,duration_sec=1247,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:08.659278 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:08.659632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:617 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:10.656955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:618 started Sep 30 09:58:10.659585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0704,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=159000000,duration_sec=1249,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:10.660146 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:10.660489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:618 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:12.658011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:619 started Sep 30 09:58:12.660510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0706,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=160000000,duration_sec=1251,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:12.661068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:12.661412 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:619 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:14.658440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:620 started Sep 30 09:58:14.660877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0708,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=161000000,duration_sec=1253,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:14.661441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:14.661793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:620 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:16.659555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:621 started Sep 30 09:58:16.662182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c070a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=162000000,duration_sec=1255,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:16.662772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:16.663148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:621 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:18.660398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:622 started Sep 30 09:58:18.663010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c070c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=163000000,duration_sec=1257,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:18.663573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:18.663924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:622 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:20.661295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:623 started Sep 30 09:58:20.663753 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c070e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=163000000,duration_sec=1259,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:20.664322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:20.664677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:623 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:22.661884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:624 started Sep 30 09:58:22.664303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0710,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=164000000,duration_sec=1261,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:22.664864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:22.665240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:624 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:58:24.662995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:625 started Sep 30 09:58:24.665720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0712,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=165000000,duration_sec=1263,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:24.666289 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:24.666671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:625 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:26.664279 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:626 started Sep 30 09:58:26.667533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0714,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=167000000,duration_sec=1265,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:26.667533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:26.667978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:626 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:28.665066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:627 started Sep 30 09:58:28.667342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0716,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=167000000,duration_sec=1267,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:28.667910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:28.668255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:627 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:58:30.665713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:628 started Sep 30 09:58:30.668091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0718,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=168000000,duration_sec=1269,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:30.668657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:30.669008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:628 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:58:32.666601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:629 started Sep 30 09:58:32.668984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c071a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=169000000,duration_sec=1271,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:32.669538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:32.669882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:629 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:58:34.667478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:630 started Sep 30 09:58:34.670413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c071c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=170000000,duration_sec=1273,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:34.671008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:34.671369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:630 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:36.668734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:631 started Sep 30 09:58:36.671827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c071e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=172000000,duration_sec=1275,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:36.672386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:36.672733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:631 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:38.669185 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:632 started Sep 30 09:58:38.671529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0720,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=171000000,duration_sec=1277,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:38.672124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:38.672477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:632 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:58:40.670463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:633 started Sep 30 09:58:40.672850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0722,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=173000000,duration_sec=1279,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:40.673421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:40.673775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:633 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:58:42.670904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:634 started Sep 30 09:58:42.673213 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0724,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=173000000,duration_sec=1281,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:42.673772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:42.674116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:634 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:58:44.671376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:635 started Sep 30 09:58:44.673722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0726,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=174000000,duration_sec=1283,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:44.674276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:44.674657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:635 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:58:46.672547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:636 started Sep 30 09:58:46.674981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0728,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=175000000,duration_sec=1285,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:46.675580 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:46.675948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:636 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:48.095918 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-363a08d2-c0c5-4f7f-acc1-1e66665b4df3 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource Port deleted: 3ae594d2-36a9-40e5-a761-ef753fb8256c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:58:48.097143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-363a08d2-c0c5-4f7f-acc1-1e66665b4df3 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (3ae594d2-36a9-40e5-a761-ef753fb8256c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:58:48.673019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:637 started Sep 30 09:58:48.675458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c072a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=175000000,duration_sec=1287,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:48.676127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:48.676521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:637 - starting polling. Elapsed:0.004 Sep 30 09:58:48.678648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:58:48.680102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 3ae594d2-36a9-40e5-a761-ef753fb8256c not present in bridge br-int Sep 30 09:58:48.680560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:58:48.680887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['3ae594d2-36a9-40e5-a761-ef753fb8256c'] Sep 30 09:58:48.681270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 3ae594d2-36a9-40e5-a761-ef753fb8256c is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:58:48.683942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:637 - port information retrieved. Elapsed:0.011 Sep 30 09:58:48.684335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:637 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:58:50.673682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:638 started Sep 30 09:58:50.676012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c072c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=176000000,duration_sec=1289,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:50.676577 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:50.676932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:638 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:58:51.699654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f5c32219-e8f4-41cc-b6f8-b36bc7e41e95 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource Port deleted: 31deec85-f41f-469f-8cb8-d5828a5ff711 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:58:51.700302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f5c32219-e8f4-41cc-b6f8-b36bc7e41e95 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (31deec85-f41f-469f-8cb8-d5828a5ff711), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:58:51.700675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-f5c32219-e8f4-41cc-b6f8-b36bc7e41e95 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group member updated {'6fa83794-f114-4d02-9d65-747e3bcbcdb0'} Sep 30 09:58:52.674749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:639 started Sep 30 09:58:52.677264 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c072e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=177000000,duration_sec=1291,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:52.677883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:52.678420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:639 - starting polling. Elapsed:0.004 Sep 30 09:58:52.680535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:58:52.682065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 31deec85-f41f-469f-8cb8-d5828a5ff711 not present in bridge br-int Sep 30 09:58:52.682395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:58:52.682702 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['31deec85-f41f-469f-8cb8-d5828a5ff711'] Sep 30 09:58:52.683020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 31deec85-f41f-469f-8cb8-d5828a5ff711 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:58:52.685561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:639 - port information retrieved. Elapsed:0.011 Sep 30 09:58:52.685891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:639 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:58:54.675220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:640 started Sep 30 09:58:54.678015 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0730,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=178000000,duration_sec=1293,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:54.678583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:54.678961 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:640 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:58:56.629149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2e1e2636-e41d-4dea-9111-3d5dd2ed4550 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource Port deleted: cdcd3d52-4f21-4eeb-b6a1-a3d8fee30e42 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:58:56.635305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2e1e2636-e41d-4dea-9111-3d5dd2ed4550 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (cdcd3d52-4f21-4eeb-b6a1-a3d8fee30e42), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:58:56.676118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:641 started Sep 30 09:58:56.678483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0732,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=178000000,duration_sec=1295,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:56.679115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:56.679450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:641 - starting polling. Elapsed:0.003 Sep 30 09:58:56.681462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:58:56.683022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port cdcd3d52-4f21-4eeb-b6a1-a3d8fee30e42 not present in bridge br-int Sep 30 09:58:56.683467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:58:56.684077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['cdcd3d52-4f21-4eeb-b6a1-a3d8fee30e42'] Sep 30 09:58:56.684077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port cdcd3d52-4f21-4eeb-b6a1-a3d8fee30e42 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:58:56.686844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:641 - port information retrieved. Elapsed:0.011 Sep 30 09:58:56.689274 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:641 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:58:58.677619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:642 started Sep 30 09:58:58.687236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0734,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=181000000,duration_sec=1297,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:58:58.688328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:58:58.688841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:642 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:58:59.713515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-70c6adc2-1186-40d9-85db-120f5e8d0dab tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource Port deleted: 3570f723-a6b6-479e-9662-f90c771a0449 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:58:59.714087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-70c6adc2-1186-40d9-85db-120f5e8d0dab tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (3570f723-a6b6-479e-9662-f90c771a0449), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:58:59.714293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-70c6adc2-1186-40d9-85db-120f5e8d0dab tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group member updated {'6fa83794-f114-4d02-9d65-747e3bcbcdb0'} Sep 30 09:59:00.678659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:643 started Sep 30 09:59:00.681097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0736,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=181000000,duration_sec=1299,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:00.681665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:00.681993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:643 - starting polling. Elapsed:0.004 Sep 30 09:59:00.684014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:00.685404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 3570f723-a6b6-479e-9662-f90c771a0449 not present in bridge br-int Sep 30 09:59:00.685728 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:59:00.686003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['3570f723-a6b6-479e-9662-f90c771a0449'] Sep 30 09:59:00.686311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 3570f723-a6b6-479e-9662-f90c771a0449 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:59:00.689355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:643 - port information retrieved. Elapsed:0.011 Sep 30 09:59:00.689676 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:643 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:59:02.471444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-86279dc1-f08d-40ca-aeb2-36a375138c0f tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource Port deleted: 5bfa79fa-834c-44fe-ba53-34a1f807779e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:02.472552 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-86279dc1-f08d-40ca-aeb2-36a375138c0f tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (5bfa79fa-834c-44fe-ba53-34a1f807779e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:02.679050 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:644 started Sep 30 09:59:02.681546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0738,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=181000000,duration_sec=1301,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:02.682122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:02.682455 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:644 - starting polling. Elapsed:0.004 Sep 30 09:59:02.684501 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:02.685936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 5bfa79fa-834c-44fe-ba53-34a1f807779e not present in bridge br-int Sep 30 09:59:02.688768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:59:02.688768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['5bfa79fa-834c-44fe-ba53-34a1f807779e'] Sep 30 09:59:02.688768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 5bfa79fa-834c-44fe-ba53-34a1f807779e is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:59:02.689428 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:644 - port information retrieved. Elapsed:0.011 Sep 30 09:59:02.689757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:644 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 09:59:04.163709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource SecurityGroup deleted: 6fa83794-f114-4d02-9d65-747e3bcbcdb0 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:04.164309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (6fa83794-f114-4d02-9d65-747e3bcbcdb0), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:04.164540 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('6fa83794-f114-4d02-9d65-747e3bcbcdb0',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:59:04.177591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('6fa83794-f114-4d02-9d65-747e3bcbcdb0',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:59:04.182642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource SecurityGroupRule deleted: 1548a533-d7cc-48d6-87f8-940e7f7c3e91 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:04.182642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (1548a533-d7cc-48d6-87f8-940e7f7c3e91), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:04.182642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:59:04.182642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource SecurityGroupRule deleted: 8ab893a1-4ce2-4b9a-9727-11c6a5a43e37 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:04.183081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8ab893a1-4ce2-4b9a-9727-11c6a5a43e37), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:04.183081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:59:04.183081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource SecurityGroupRule deleted: 957a22ae-98bc-4e9b-8bfc-9a0443f3351e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:04.183081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (957a22ae-98bc-4e9b-8bfc-9a0443f3351e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:04.183408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:59:04.183408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource SecurityGroupRule deleted: fb902209-0d2d-4707-9fc9-2733d28dabf5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:04.183408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (fb902209-0d2d-4707-9fc9-2733d28dabf5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:04.183408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:59:04.183408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource SecurityGroupRule deleted: 7a1d4ae3-053b-4dbf-9d1a-e9d3773987b7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:04.183774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7a1d4ae3-053b-4dbf-9d1a-e9d3773987b7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:04.183774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:59:04.183774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource SecurityGroupRule deleted: 2a4bc5df-3aa0-4336-8845-9241a0b21505 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:04.184089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2a4bc5df-3aa0-4336-8845-9241a0b21505), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:04.184595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:59:04.184967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource SecurityGroupRule deleted: c0f8d499-bf6f-443c-a5b2-1b33809f8ee1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:04.185320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c0f8d499-bf6f-443c-a5b2-1b33809f8ee1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:04.185629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:59:04.186016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Resource SecurityGroupRule deleted: b4dca7b9-69d2-46f9-a227-a415f8378f92 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:04.186349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b4dca7b9-69d2-46f9-a227-a415f8378f92), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:04.186713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-49729ec5-942e-4f2d-ba87-73258f6872b6 tempest-TestVolumeBootPattern-1826206613 tempest-TestVolumeBootPattern-1826206613-project] Security group rule updated ['6fa83794-f114-4d02-9d65-747e3bcbcdb0'] Sep 30 09:59:04.680253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:645 started Sep 30 09:59:04.683391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c073a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=183000000,duration_sec=1303,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:04.687124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:04.687124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:645 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:05.291044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-dc50fc5e-3a76-43b1-85bb-589e886cabf9 admin admin] Resource Port deleted: fbf021f9-ae35-47af-9243-953bba459691 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:05.291722 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-dc50fc5e-3a76-43b1-85bb-589e886cabf9 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (fbf021f9-ae35-47af-9243-953bba459691), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:06.602934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["80b98fcc-27bd-476c-9a64-e13ea321b5aa","delete","qr-fbf021f9-ae",29,["map",[["attached-mac","fa:16:3e:15:54:bc"],["iface-id","fbf021f9-ae35-47af-9243-953bba459691"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:59:06.681240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:646 started Sep 30 09:59:06.722669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-40717989-1dfe-470a-8c0e-2d5148437577 admin admin] Resource Port deleted: 6c896384-3d9b-4662-a8e4-e5f3e48a43bc {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:06.723271 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-40717989-1dfe-470a-8c0e-2d5148437577 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (6c896384-3d9b-4662-a8e4-e5f3e48a43bc), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:06.881612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c073c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=381000000,duration_sec=1305,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:06.885269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:06.885962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:646 - starting polling. Elapsed:0.205 Sep 30 09:59:06.888157 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:06.891867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(table=Port, record=qg-6c896384-3d, col_values=(('tag', 4095),)) {{(pid=114230) do_commit /usr/local/lib/python3.8/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:90}} Sep 30 09:59:06.905130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c073e,OFPFlowMod(buffer_id=4294967295,command=0,cookie=17454195956231332773,cookie_mask=0,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=0,out_port=0,priority=2,table_id=0) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:06.905529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['6c896384-3d9b-4662-a8e4-e5f3e48a43bc'] Sep 30 09:59:06.906524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:59:06.944679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d99f69-fcc4-4670-b2cb-530d65bfd786]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:59:06.949836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0740,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 29}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:06.950247 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:646 - port information retrieved. Elapsed:0.269 Sep 30 09:59:06.950578 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'fd42b73f-bf14-484c-8d39-4446ddb373b6', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'beeb0a48-a86c-43a4-9603-e4b77a8d536b', '54c4d0b4-c612-4724-9902-f7424400906b', '0a907ef6-0733-4f96-9909-bd47d7e38800', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc', '452383da-1307-41b6-9960-d5a92f51b39f', '476f0e98-0f2c-4e96-9e9d-e51e538823f1', '56479e13-743f-48e1-a33c-f8888b22c96a', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'fbf021f9-ae35-47af-9243-953bba459691'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:59:06.950949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:646 - agent port security group processed in 0.000 Sep 30 09:59:06.952595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:59:06.953517 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'fbf021f9-ae35-47af-9243-953bba459691'} Sep 30 09:59:06.953975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:59:06.988570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["3e6a7f60-0ce8-4f9d-91eb-0777c238318b","delete","qg-6c896384-3d",28,["map",[["attached-mac","fa:16:3e:1a:74:6e"],["iface-id","6c896384-3d9b-4662-a8e4-e5f3e48a43bc"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:59:07.306573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a468df-ab37-481d-aee0-93ae24037def]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:59:07.307209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'fbf021f9-ae35-47af-9243-953bba459691'} removed Sep 30 09:59:07.399306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-4fe4373b-1cd6-4b43-990e-ad79ee38f93b admin admin] Resource Subnet deleted: 17feeb99-a150-43e4-9bdf-e5689885a334 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:07.400216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-4fe4373b-1cd6-4b43-990e-ad79ee38f93b admin admin] Publish callbacks [] for Subnet (17feeb99-a150-43e4-9bdf-e5689885a334), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:07.476339 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:59:07.477062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:646 - treat_devices_removed completed in 0.524 Sep 30 09:59:07.477537 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:646 - ports processed. Elapsed:0.796 Sep 30 09:59:07.477831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:646 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.797 Sep 30 09:59:07.600679 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["01d9f98d-1b09-491e-afa7-a4e464117ef3","delete","tapfd42b73f-bf",27,["map",[["attached-mac","fa:16:3e:63:9f:1d"],["iface-id","fd42b73f-bf14-484c-8d39-4446ddb373b6"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:59:07.801666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-11f691d8-1e6b-4df8-9444-56ce502653d4 admin admin] Resource Port deleted: fd42b73f-bf14-484c-8d39-4446ddb373b6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:07.802317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-11f691d8-1e6b-4df8-9444-56ce502653d4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (fd42b73f-bf14-484c-8d39-4446ddb373b6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:07.876295 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f16679b4-f6c5-4505-bda7-a3143f939f8f None None] Resource Port deleted: fd42b73f-bf14-484c-8d39-4446ddb373b6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:07.876744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f16679b4-f6c5-4505-bda7-a3143f939f8f None None] Skipped duplicate delete event for fd42b73f-bf14-484c-8d39-4446ddb373b6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 30 09:59:08.095608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-11f691d8-1e6b-4df8-9444-56ce502653d4 admin admin] Resource Network deleted: 3408b8b1-1a84-4fa0-8af6-da7419c2525d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:08.095985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-11f691d8-1e6b-4df8-9444-56ce502653d4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (3408b8b1-1a84-4fa0-8af6-da7419c2525d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:08.681954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:647 started Sep 30 09:59:08.684329 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0742,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=184000000,duration_sec=1307,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:08.684908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:08.685364 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:647 - starting polling. Elapsed:0.004 Sep 30 09:59:08.687780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:08.691999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0744,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 27}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:08.693477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0746,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 28}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:08.693808 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:647 - port information retrieved. Elapsed:0.012 Sep 30 09:59:08.694112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'e87f42eb-c1d9-464e-aa60-6d70059896bb', 'beeb0a48-a86c-43a4-9603-e4b77a8d536b', '54c4d0b4-c612-4724-9902-f7424400906b', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '476f0e98-0f2c-4e96-9e9d-e51e538823f1', '56479e13-743f-48e1-a33c-f8888b22c96a', '2aec6d92-a4cd-4845-88ae-1b87a008cc45', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'fd42b73f-bf14-484c-8d39-4446ddb373b6', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:59:08.694432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:647 - agent port security group processed in 0.000 Sep 30 09:59:08.695963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:59:08.696259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'fd42b73f-bf14-484c-8d39-4446ddb373b6', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc'} Sep 30 09:59:08.696832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 6c896384-3d9b-4662-a8e4-e5f3e48a43bc is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 09:59:08.697191 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:59:08.744349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ee5b33-635b-443f-9739-bb53bea26ece]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:59:08.745179 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'fd42b73f-bf14-484c-8d39-4446ddb373b6', '6c896384-3d9b-4662-a8e4-e5f3e48a43bc'} removed Sep 30 09:59:08.792106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:59:08.792626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Reclaiming vlan = 11 from net-id = 3408b8b1-1a84-4fa0-8af6-da7419c2525d, seg-id = 367 Sep 30 09:59:08.796434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xc9105f10,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16864421859504038737,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4107}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:08.798499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xf1c0748,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4463}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:08.798934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 09:59:08.799294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:647 - treat_devices_removed completed in 0.103 Sep 30 09:59:08.799642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:647 - ports processed. Elapsed:0.118 Sep 30 09:59:08.800029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:647 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.118 Sep 30 09:59:08.979367 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8aad8647-e85d-4696-9795-4fe05a3fdbf1 admin admin] Resource Port deleted: 2aec6d92-a4cd-4845-88ae-1b87a008cc45 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:08.979971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8aad8647-e85d-4696-9795-4fe05a3fdbf1 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (2aec6d92-a4cd-4845-88ae-1b87a008cc45), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:10.068569 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["d2a4f5a2-9348-4aba-9486-58de666ca78b","delete","qr-2aec6d92-a4",32,["map",[["attached-mac","fa:16:3e:c9:b1:ae"],["iface-id","2aec6d92-a4cd-4845-88ae-1b87a008cc45"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:59:10.121705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f16e8190-774a-4cb9-8ad3-d33c257d9c22 admin admin] Resource Port deleted: e87f42eb-c1d9-464e-aa60-6d70059896bb {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:10.122095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f16e8190-774a-4cb9-8ad3-d33c257d9c22 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (e87f42eb-c1d9-464e-aa60-6d70059896bb), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:10.465973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["a44df361-4490-4dd6-a6da-3b88699a1b7f","delete","qg-e87f42eb-c1",31,["map",[["attached-mac","fa:16:3e:27:2d:c2"],["iface-id","e87f42eb-c1d9-464e-aa60-6d70059896bb"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:59:10.683600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:648 started Sep 30 09:59:10.684523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-f62008cc-16a1-43f0-bc6f-85c6e02bd367 admin admin] Resource Subnet deleted: 248eeeb2-071e-427b-b827-6d99e6e35d4e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:10.684969 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-f62008cc-16a1-43f0-bc6f-85c6e02bd367 admin admin] Publish callbacks [] for Subnet (248eeeb2-071e-427b-b827-6d99e6e35d4e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:10.757290 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c074a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=253000000,duration_sec=1309,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:10.758730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:10.759064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:648 - starting polling. Elapsed:0.075 Sep 30 09:59:10.760845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:10.765867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c074c,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 32}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:10.770129 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c074e,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 31}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:10.770682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:648 - port information retrieved. Elapsed:0.087 Sep 30 09:59:10.771193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48', 'beeb0a48-a86c-43a4-9603-e4b77a8d536b', '54c4d0b4-c612-4724-9902-f7424400906b', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '476f0e98-0f2c-4e96-9e9d-e51e538823f1', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'2aec6d92-a4cd-4845-88ae-1b87a008cc45', 'e87f42eb-c1d9-464e-aa60-6d70059896bb'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:59:10.771696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:648 - agent port security group processed in 0.000 Sep 30 09:59:10.774051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:59:10.775180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'2aec6d92-a4cd-4845-88ae-1b87a008cc45', 'e87f42eb-c1d9-464e-aa60-6d70059896bb'} Sep 30 09:59:10.775830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 8 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:59:10.831241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93da862-e1b9-45a0-89ac-d5c57f3d401c]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:59:10.831811 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'2aec6d92-a4cd-4845-88ae-1b87a008cc45', 'e87f42eb-c1d9-464e-aa60-6d70059896bb'} removed Sep 30 09:59:10.837527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5d9bb344-6210-4e7d-8e3b-78301c60af9a","delete","tap6b6494e4-74",30,["map",[["attached-mac","fa:16:3e:01:ac:7c"],["iface-id","6b6494e4-74c0-498e-9e7b-c0a784d5ff48"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 09:59:10.890190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:59:10.890190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:648 - treat_devices_removed completed in 0.113 Sep 30 09:59:10.890190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:648 - ports processed. Elapsed:0.204 Sep 30 09:59:10.890190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:648 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.204 Sep 30 09:59:11.072347 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c8ebb85b-409a-475a-a79c-0bf3cd1ddc86 admin admin] Resource Port deleted: 6b6494e4-74c0-498e-9e7b-c0a784d5ff48 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:11.073499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c8ebb85b-409a-475a-a79c-0bf3cd1ddc86 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (6b6494e4-74c0-498e-9e7b-c0a784d5ff48), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:11.125646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-74d491d2-55a1-4549-ab2c-f87b119b46a7 None None] Resource Port deleted: 6b6494e4-74c0-498e-9e7b-c0a784d5ff48 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:11.125988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-74d491d2-55a1-4549-ab2c-f87b119b46a7 None None] Skipped duplicate delete event for 6b6494e4-74c0-498e-9e7b-c0a784d5ff48 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 30 09:59:11.405174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-c8ebb85b-409a-475a-a79c-0bf3cd1ddc86 admin admin] Resource Network deleted: a1a947f8-b8f0-49fd-a3af-298fa4634634 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:11.405651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-c8ebb85b-409a-475a-a79c-0bf3cd1ddc86 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (a1a947f8-b8f0-49fd-a3af-298fa4634634), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:11.857693 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Resource SecurityGroup deleted: 8d4b6639-6e2e-4411-9eed-9ee6bccd6d66 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:11.858056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (8d4b6639-6e2e-4411-9eed-9ee6bccd6d66), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:11.858533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('8d4b6639-6e2e-4411-9eed-9ee6bccd6d66',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:59:11.876396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('8d4b6639-6e2e-4411-9eed-9ee6bccd6d66',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:59:11.876966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Resource SecurityGroupRule deleted: 225aaa06-9cb6-447d-a723-e9a6905aedc9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:11.878130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (225aaa06-9cb6-447d-a723-e9a6905aedc9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:11.878539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Security group rule updated ['8d4b6639-6e2e-4411-9eed-9ee6bccd6d66'] Sep 30 09:59:11.879450 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Resource SecurityGroupRule deleted: 2afbb227-44c0-48eb-b149-e45b418b1cb1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:11.880032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2afbb227-44c0-48eb-b149-e45b418b1cb1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:11.880362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Security group rule updated ['8d4b6639-6e2e-4411-9eed-9ee6bccd6d66'] Sep 30 09:59:11.881142 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Resource SecurityGroupRule deleted: 683ebe9e-a23c-48eb-a450-e77458fb77c3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:11.881633 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (683ebe9e-a23c-48eb-a450-e77458fb77c3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:11.883887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Security group rule updated ['8d4b6639-6e2e-4411-9eed-9ee6bccd6d66'] Sep 30 09:59:11.884285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Resource SecurityGroupRule deleted: 695fe5dc-2144-457a-8150-a052e7557d6a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:11.884636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (695fe5dc-2144-457a-8150-a052e7557d6a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:11.884959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-83b2e305-c497-4792-86f4-ddef7e7c1330 admin admin] Security group rule updated ['8d4b6639-6e2e-4411-9eed-9ee6bccd6d66'] Sep 30 09:59:12.684518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:649 started Sep 30 09:59:12.686921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Resource SecurityGroup deleted: c282cf4a-ae93-4666-b35f-ef2541fbedd4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:12.687302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (c282cf4a-ae93-4666-b35f-ef2541fbedd4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:12.687756 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('c282cf4a-ae93-4666-b35f-ef2541fbedd4',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 09:59:12.691826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0750,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=191000000,duration_sec=1311,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:12.692760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:12.693189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:649 - starting polling. Elapsed:0.009 Sep 30 09:59:12.694733 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:12.699028 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0752,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 30}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:12.699521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:649 - port information retrieved. Elapsed:0.015 Sep 30 09:59:12.702705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'beeb0a48-a86c-43a4-9603-e4b77a8d536b', '54c4d0b4-c612-4724-9902-f7424400906b', '0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '476f0e98-0f2c-4e96-9e9d-e51e538823f1', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 09:59:12.702705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:649 - agent port security group processed in 0.000 Sep 30 09:59:12.702705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 09:59:12.702705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48'} Sep 30 09:59:12.702705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 09:59:12.703493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('c282cf4a-ae93-4666-b35f-ef2541fbedd4',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 09:59:12.704099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Resource SecurityGroupRule deleted: 2667f47f-6af9-4e0a-b9cc-a98bae117b58 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:12.704649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (2667f47f-6af9-4e0a-b9cc-a98bae117b58), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:12.704960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Security group rule updated ['c282cf4a-ae93-4666-b35f-ef2541fbedd4'] Sep 30 09:59:12.705836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Resource SecurityGroupRule deleted: 9c2618c4-5b2f-47e7-a2ab-7e1bc18af883 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:12.706190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (9c2618c4-5b2f-47e7-a2ab-7e1bc18af883), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:12.706502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Security group rule updated ['c282cf4a-ae93-4666-b35f-ef2541fbedd4'] Sep 30 09:59:12.707094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Resource SecurityGroupRule deleted: a2ff853c-9ba2-4c83-815d-20c0897f459e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:12.707655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (a2ff853c-9ba2-4c83-815d-20c0897f459e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:12.708043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Security group rule updated ['c282cf4a-ae93-4666-b35f-ef2541fbedd4'] Sep 30 09:59:12.708407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Resource SecurityGroupRule deleted: c6474172-4f0a-4bcb-9530-57b98f8f8994 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 09:59:12.709047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c6474172-4f0a-4bcb-9530-57b98f8f8994), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 09:59:12.709466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b2587663-2242-422b-8117-dc0d87491398 admin admin] Security group rule updated ['c282cf4a-ae93-4666-b35f-ef2541fbedd4'] Sep 30 09:59:12.752064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[8945ff96-6ad5-4e5c-9d66-80804d4722d3]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 09:59:12.752614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'6b6494e4-74c0-498e-9e7b-c0a784d5ff48'} removed Sep 30 09:59:12.780491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 09:59:12.780994 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Reclaiming vlan = 12 from net-id = a1a947f8-b8f0-49fd-a3af-298fa4634634, seg-id = 350 Sep 30 09:59:12.785018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xc9105f12,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16864421859504038737,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4108}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:12.787794 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xf1c0754,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4446}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:12.788123 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:649 - treat_devices_removed completed in 0.087 Sep 30 09:59:12.788430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:649 - ports processed. Elapsed:0.104 Sep 30 09:59:12.788849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:649 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.104 Sep 30 09:59:14.685167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:650 started Sep 30 09:59:14.687589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0756,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=187000000,duration_sec=1313,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:14.688159 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:14.688511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:650 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:59:16.685775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:651 started Sep 30 09:59:16.688158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0758,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=188000000,duration_sec=1315,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:16.688721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:16.689100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:651 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:59:18.686678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:652 started Sep 30 09:59:18.689242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c075a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=189000000,duration_sec=1317,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:18.689799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:18.690150 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:652 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:20.687832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:653 started Sep 30 09:59:20.690662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c075c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=190000000,duration_sec=1319,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:20.691220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:20.691568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:653 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:22.689220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:654 started Sep 30 09:59:22.692194 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c075e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=191000000,duration_sec=1321,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:22.692798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:22.693170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:654 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:24.689888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:655 started Sep 30 09:59:24.692870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0760,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=193000000,duration_sec=1323,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:24.693459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:24.693810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:655 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:26.690837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:656 started Sep 30 09:59:26.693205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0762,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=193000000,duration_sec=1325,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:26.694091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:26.694454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:656 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:28.691988 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:657 started Sep 30 09:59:28.694395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0764,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=194000000,duration_sec=1327,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:28.694985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:28.695340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:657 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:30.692587 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:658 started Sep 30 09:59:30.695094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0766,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=195000000,duration_sec=1329,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:30.695666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:30.696018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:658 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:32.693551 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:659 started Sep 30 09:59:32.696009 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0768,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=196000000,duration_sec=1331,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:32.696571 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:32.696921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:659 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:34.694582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:660 started Sep 30 09:59:34.697283 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c076a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=197000000,duration_sec=1333,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:34.697842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:34.698272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:660 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:36.695460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:661 started Sep 30 09:59:36.697798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c076c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=198000000,duration_sec=1335,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:36.698352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:36.698724 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:661 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:59:38.695949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:662 started Sep 30 09:59:38.698335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c076e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=198000000,duration_sec=1337,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:38.698942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:38.704512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:662 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:40.696481 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:663 started Sep 30 09:59:40.706953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0770,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=199000000,duration_sec=1339,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:40.706953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:40.706953 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:663 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:42.697987 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:664 started Sep 30 09:59:42.700335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0772,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=200000000,duration_sec=1341,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:42.700907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:42.701287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:664 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:44.699002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:665 started Sep 30 09:59:44.706026 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0774,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=201000000,duration_sec=1343,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:44.706899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:44.707304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:665 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 09:59:46.699858 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:666 started Sep 30 09:59:46.702204 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0776,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=202000000,duration_sec=1345,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:46.702813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:46.703164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:666 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:59:48.700338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:667 started Sep 30 09:59:48.702704 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0778,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=203000000,duration_sec=1347,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:48.703273 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:48.703621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:667 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:59:50.700840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:668 started Sep 30 09:59:50.703258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c077a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=203000000,duration_sec=1349,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:50.703789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:50.704133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:668 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 09:59:52.701472 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:669 started Sep 30 09:59:52.703865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c077c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=204000000,duration_sec=1351,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:52.704471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:52.704910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:669 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:54.702122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:670 started Sep 30 09:59:54.704671 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c077e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=204000000,duration_sec=1353,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:54.705235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:54.705585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:670 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:56.702985 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:671 started Sep 30 09:59:56.705359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0780,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=205000000,duration_sec=1355,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:56.706282 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:56.706667 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:671 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 09:59:58.703491 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:672 started Sep 30 09:59:58.705877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0782,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=206000000,duration_sec=1357,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 09:59:58.706442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 09:59:58.706820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:672 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:00:00.703992 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:673 started Sep 30 10:00:00.706320 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0784,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=206000000,duration_sec=1359,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:00.706946 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:00.707294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:673 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:00:02.705073 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:674 started Sep 30 10:00:02.708253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0786,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=208000000,duration_sec=1361,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:02.708888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:02.709241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:674 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:00:04.705978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:675 started Sep 30 10:00:04.709217 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0788,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=209000000,duration_sec=1363,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:04.709786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:04.710141 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:675 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:00:06.707493 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:676 started Sep 30 10:00:06.710162 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c078a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=210000000,duration_sec=1365,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:06.710755 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:06.711109 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:676 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:00:08.708462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:677 started Sep 30 10:00:08.710820 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c078c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=211000000,duration_sec=1367,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:08.714153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:08.714153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:677 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:00:10.709415 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:678 started Sep 30 10:00:10.711829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c078e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=212000000,duration_sec=1369,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:10.712452 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:10.712806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:678 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:00:12.709856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:679 started Sep 30 10:00:12.712324 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0790,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=212000000,duration_sec=1371,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:12.712894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:12.713249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:679 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:00:14.710502 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:680 started Sep 30 10:00:14.712957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0792,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=213000000,duration_sec=1373,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:14.713520 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:14.713866 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:680 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:00:16.711300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:681 started Sep 30 10:00:16.713678 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0794,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=214000000,duration_sec=1375,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:16.714245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:16.714611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:681 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:00:18.711894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:682 started Sep 30 10:00:18.714192 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0796,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=214000000,duration_sec=1377,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:18.714792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:18.715145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:682 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:00:20.712614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:683 started Sep 30 10:00:20.714982 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0798,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=215000000,duration_sec=1379,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:20.715547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:20.715897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:683 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:00:22.714004 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:684 started Sep 30 10:00:22.716335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c079a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=216000000,duration_sec=1381,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:22.716894 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:22.717240 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:684 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:00:24.715165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:685 started Sep 30 10:00:24.717506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c079c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=217000000,duration_sec=1383,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:24.718065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:24.718434 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:685 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:00:26.715872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:686 started Sep 30 10:00:26.718235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c079e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=218000000,duration_sec=1385,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:26.718848 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:26.719195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:686 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:00:28.716635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:687 started Sep 30 10:00:28.719025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=219000000,duration_sec=1387,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:28.719608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:28.719935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:687 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:00:29.948785 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-e8d54b52-f8b6-47c7-9be1-851b30e2bf68 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource Port deleted: 8354001a-2686-4424-85b3-eda11d52c3b4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:00:29.949337 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-e8d54b52-f8b6-47c7-9be1-851b30e2bf68 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (8354001a-2686-4424-85b3-eda11d52c3b4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:29.949570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-e8d54b52-f8b6-47c7-9be1-851b30e2bf68 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group member updated {'147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f'} Sep 30 10:00:30.717398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:688 started Sep 30 10:00:30.720096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=220000000,duration_sec=1389,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:30.720680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:30.721036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:688 - starting polling. Elapsed:0.004 Sep 30 10:00:30.723242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:30.724251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 8354001a-2686-4424-85b3-eda11d52c3b4 not present in bridge br-int Sep 30 10:00:30.724584 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 10:00:30.724865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['8354001a-2686-4424-85b3-eda11d52c3b4'] Sep 30 10:00:30.725272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 8354001a-2686-4424-85b3-eda11d52c3b4 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 10:00:30.727049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:688 - port information retrieved. Elapsed:0.010 Sep 30 10:00:30.727383 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:688 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.010 Sep 30 10:00:32.346255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource SecurityGroup deleted: 147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:00:32.351662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:32.351662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 10:00:32.360974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 10:00:32.361474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource SecurityGroupRule deleted: 093a3eff-edbc-4313-b75c-c5cb8db79dcc {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:00:32.361849 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (093a3eff-edbc-4313-b75c-c5cb8db79dcc), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:32.362187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f'] Sep 30 10:00:32.362583 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource SecurityGroupRule deleted: d81049d6-6357-48d0-b1ae-0e88c12f5980 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:00:32.362965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d81049d6-6357-48d0-b1ae-0e88c12f5980), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:32.363454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f'] Sep 30 10:00:32.363837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource SecurityGroupRule deleted: 8050062d-77ef-4295-913d-a3075153322b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:00:32.364182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8050062d-77ef-4295-913d-a3075153322b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:32.364504 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f'] Sep 30 10:00:32.364879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource SecurityGroupRule deleted: 80dddb3f-60e8-4213-b9b2-67d86e622c1c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:00:32.365225 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (80dddb3f-60e8-4213-b9b2-67d86e622c1c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:32.365673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-ac61af8c-8741-47e5-afb0-1b52080e85ac tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['147ce1c4-a5ba-49e4-aed8-d0583f2b2a0f'] Sep 30 10:00:32.718408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:689 started Sep 30 10:00:32.721376 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=221000000,duration_sec=1391,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:32.722037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:32.722389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:689 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:00:32.736325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-2ca164e0-f251-48a7-8b55-37ebf1de7f91 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource Port deleted: 24dfc452-1f4b-4e9f-a7d4-2210935e8eb3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:00:32.736779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-2ca164e0-f251-48a7-8b55-37ebf1de7f91 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (24dfc452-1f4b-4e9f-a7d4-2210935e8eb3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:33.156051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-76b6bad3-8132-4290-9a44-e1ea32908ddd tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T10:00:33Z,description='tempest-description--1024470218',id=f2a6c367-7862-4ec6-9997-942326f64401,is_default=False,name='tempest-securitygroup--1715404644',project_id='85eef8fd790146cfa7da6214c13ca262',revision_number=1,rules=[SecurityGroupRule(7933048b-f33b-4407-90b5-833e44f9fd3b),SecurityGroupRule(db344460-73ef-4b7a-86bc-d60b87ab938f)],shared=False,stateful=True,updated_at=2022-09-30T10:00:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:00:33.156424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-76b6bad3-8132-4290-9a44-e1ea32908ddd tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (f2a6c367-7862-4ec6-9997-942326f64401), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:33.157063 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-76b6bad3-8132-4290-9a44-e1ea32908ddd tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:00:33Z,description=,direction='egress',ethertype='IPv6',id=7933048b-f33b-4407-90b5-833e44f9fd3b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eef8fd790146cfa7da6214c13ca262',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f2a6c367-7862-4ec6-9997-942326f64401,updated_at=2022-09-30T10:00:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:00:33.157400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-76b6bad3-8132-4290-9a44-e1ea32908ddd tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (7933048b-f33b-4407-90b5-833e44f9fd3b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:33.157729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-76b6bad3-8132-4290-9a44-e1ea32908ddd tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['f2a6c367-7862-4ec6-9997-942326f64401'] Sep 30 10:00:33.158420 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-76b6bad3-8132-4290-9a44-e1ea32908ddd tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:00:33Z,description=,direction='egress',ethertype='IPv4',id=db344460-73ef-4b7a-86bc-d60b87ab938f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eef8fd790146cfa7da6214c13ca262',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f2a6c367-7862-4ec6-9997-942326f64401,updated_at=2022-09-30T10:00:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:00:33.158796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-76b6bad3-8132-4290-9a44-e1ea32908ddd tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (db344460-73ef-4b7a-86bc-d60b87ab938f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:33.159117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-76b6bad3-8132-4290-9a44-e1ea32908ddd tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['f2a6c367-7862-4ec6-9997-942326f64401'] Sep 30 10:00:33.413545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-9b5199e2-0209-4491-a8d9-d5d5daf05841 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:00:33Z,description='',direction='ingress',ethertype='IPv4',id=83b6ca8a-6973-49e3-9bbf-94281674b6e0,normalized_cidr=None,port_range_max=22,port_range_min=22,project_id='85eef8fd790146cfa7da6214c13ca262',protocol='tcp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f2a6c367-7862-4ec6-9997-942326f64401,updated_at=2022-09-30T10:00:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:00:33.414153 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9b5199e2-0209-4491-a8d9-d5d5daf05841 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (83b6ca8a-6973-49e3-9bbf-94281674b6e0), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:33.414302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9b5199e2-0209-4491-a8d9-d5d5daf05841 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['f2a6c367-7862-4ec6-9997-942326f64401'] Sep 30 10:00:33.733349 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-7f58e98a-4fb3-4756-be86-b38dd709f5db tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:00:33Z,description='',direction='ingress',ethertype='IPv4',id=28a29da7-33ff-471a-bf71-a971ef4116c5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='85eef8fd790146cfa7da6214c13ca262',protocol='icmp',remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f2a6c367-7862-4ec6-9997-942326f64401,updated_at=2022-09-30T10:00:33Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:00:33.733725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-7f58e98a-4fb3-4756-be86-b38dd709f5db tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (28a29da7-33ff-471a-bf71-a971ef4116c5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:33.734113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-7f58e98a-4fb3-4756-be86-b38dd709f5db tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['f2a6c367-7862-4ec6-9997-942326f64401'] Sep 30 10:00:34.330341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d2a770cd-4dea-4b30-8bc9-f607df8d2a1e tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T10:00:33Z,data_plane_status=None,description='',device_id='PENDING',device_owner='network:floatingip',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=37bb6846-23f3-4ef8-86d2-87a1623f2047,mac_address=fa:16:3e:65:cb:fb,name='',network_id=357201ed-46d8-4a8e-b639-1f9bf08174d7,numa_affinity_policy=,project_id='',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(37bb6846-23f3-4ef8-86d2-87a1623f2047),security_group_ids=set([]),status='N/A',updated_at=2022-09-30T10:00:34Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:00:34.330748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d2a770cd-4dea-4b30-8bc9-f607df8d2a1e tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (37bb6846-23f3-4ef8-86d2-87a1623f2047), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:34.719813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:690 started Sep 30 10:00:34.722269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=222000000,duration_sec=1393,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:34.722877 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:34.723218 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:690 - starting polling. Elapsed:0.004 Sep 30 10:00:34.724711 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:34.725742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 24dfc452-1f4b-4e9f-a7d4-2210935e8eb3 not present in bridge br-int Sep 30 10:00:34.726069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 10:00:34.726359 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['24dfc452-1f4b-4e9f-a7d4-2210935e8eb3'] Sep 30 10:00:34.726747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 24dfc452-1f4b-4e9f-a7d4-2210935e8eb3 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 10:00:34.728458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:690 - port information retrieved. Elapsed:0.009 Sep 30 10:00:34.728790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:690 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 10:00:34.764850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-d2a770cd-4dea-4b30-8bc9-f607df8d2a1e tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource Port 37bb6846-23f3-4ef8-86d2-87a1623f2047 updated (revision_number 1->2). Old fields: {'device_id': 'PENDING'} New fields: {'device_id': 'ee32de26-d94b-4061-a663-1b2dd908287d'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 10:00:34.765307 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-d2a770cd-4dea-4b30-8bc9-f607df8d2a1e tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (37bb6846-23f3-4ef8-86d2-87a1623f2047), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:36.720436 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:691 started Sep 30 10:00:36.722827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=223000000,duration_sec=1395,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:36.723769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:36.723769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:691 - starting polling. Elapsed:0.003 Sep 30 10:00:36.725287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:36.727044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:691 - port information retrieved. Elapsed:0.007 Sep 30 10:00:36.727398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:691 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 10:00:38.099902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-1d5c23fc-8e2c-470b-8ae3-7326359eb408 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Received new resource Port: Port(admin_state_up=True,allowed_address_pairs=[],binding_levels=[],bindings=[PortBinding],created_at=2022-09-30T10:00:37Z,data_plane_status=None,description='',device_id='9ab42327-a15b-4fd8-ac92-a2334ed2c107',device_owner='',device_profile=,dhcp_options=[],distributed_bindings=[],dns=None,fixed_ips=[IPAllocation],id=5a8a2d85-a9ed-4cda-a769-17f985851fae,mac_address=fa:16:3e:97:81:4e,name='',network_id=6c765eee-bae8-4b34-897a-abb29acd5a27,numa_affinity_policy=,project_id='85eef8fd790146cfa7da6214c13ca262',qos_network_policy_id=None,qos_policy_id=None,revision_number=1,security=PortSecurity(5a8a2d85-a9ed-4cda-a769-17f985851fae),security_group_ids=set([f2a6c367-7862-4ec6-9997-942326f64401]),status='DOWN',updated_at=2022-09-30T10:00:37Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:00:38.100459 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-1d5c23fc-8e2c-470b-8ae3-7326359eb408 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5a8a2d85-a9ed-4cda-a769-17f985851fae), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:38.100779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-1d5c23fc-8e2c-470b-8ae3-7326359eb408 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group member updated {'f2a6c367-7862-4ec6-9997-942326f64401'} Sep 30 10:00:38.721853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:692 started Sep 30 10:00:38.725044 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=224000000,duration_sec=1397,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:38.725614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:38.725948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:692 - starting polling. Elapsed:0.004 Sep 30 10:00:38.727460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:38.729216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:692 - port information retrieved. Elapsed:0.008 Sep 30 10:00:38.729549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:692 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 10:00:38.743888 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-12c1cb1d-8c1f-4448-adbf-857aac146028 service neutron] Resource Port 5a8a2d85-a9ed-4cda-a769-17f985851fae updated (revision_number 1->2). Old fields: {'bindings': [PortBinding(host='',port_id=5a8a2d85-a9ed-4cda-a769-17f985851fae,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': ''} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=5a8a2d85-a9ed-4cda-a769-17f985851fae,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'device_owner': 'compute:nova'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 10:00:38.759034 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-12c1cb1d-8c1f-4448-adbf-857aac146028 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5a8a2d85-a9ed-4cda-a769-17f985851fae), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:39.071408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-12c1cb1d-8c1f-4448-adbf-857aac146028 service neutron] Resource Port 5a8a2d85-a9ed-4cda-a769-17f985851fae updated (revision_number 2->3). Old fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=5a8a2d85-a9ed-4cda-a769-17f985851fae,profile={},status='ACTIVE',vif_details=None,vif_type='unbound',vnic_type='normal')], 'binding_levels': []} New fields: {'bindings': [PortBinding(host='hv-cinder-maste',port_id=5a8a2d85-a9ed-4cda-a769-17f985851fae,profile={},status='ACTIVE',vif_details={"connectivity": "legacy", "port_filter": false},vif_type='hyperv',vnic_type='normal')], 'binding_levels': [PortBindingLevel(driver='hyperv',host='hv-cinder-maste',level=0,port_id=5a8a2d85-a9ed-4cda-a769-17f985851fae,segment=NetworkSegment(46a05691-a9f7-44f4-88e8-053c7fa824e0),segment_id=46a05691-a9f7-44f4-88e8-053c7fa824e0)]} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 10:00:39.071791 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-12c1cb1d-8c1f-4448-adbf-857aac146028 service neutron] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5a8a2d85-a9ed-4cda-a769-17f985851fae), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:40.723251 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:693 started Sep 30 10:00:40.726062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=225000000,duration_sec=1399,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:40.726662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:40.726997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:693 - starting polling. Elapsed:0.004 Sep 30 10:00:40.728505 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:40.730190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:693 - port information retrieved. Elapsed:0.007 Sep 30 10:00:40.730535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:693 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 10:00:42.724145 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:694 started Sep 30 10:00:42.726603 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=226000000,duration_sec=1401,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:42.727171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:42.727518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:694 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:00:43.575392 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 5a8a2d85-a9ed-4cda-a769-17f985851fae updated (revision_number 3->4). Old fields: {'status': 'DOWN'} New fields: {'status': 'BUILD'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 10:00:43.575870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5a8a2d85-a9ed-4cda-a769-17f985851fae), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:44.724865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:695 started Sep 30 10:00:44.727266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=227000000,duration_sec=1403,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:44.727836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:44.728207 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:695 - starting polling. Elapsed:0.004 Sep 30 10:00:44.730322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:44.732053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:695 - port information retrieved. Elapsed:0.007 Sep 30 10:00:44.732380 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:695 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 10:00:45.621557 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Resource Port 5a8a2d85-a9ed-4cda-a769-17f985851fae updated (revision_number 4->5). Old fields: {'status': 'BUILD'} New fields: {'status': 'ACTIVE'} {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:188}} Sep 30 10:00:45.621932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-ba1d8f87-cdc9-429f-acf0-d863ea5cf8b1 None None] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_update-497272'] for Port (5a8a2d85-a9ed-4cda-a769-17f985851fae), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:46.725977 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:696 started Sep 30 10:00:46.728398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=228000000,duration_sec=1405,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:46.728962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:46.729294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:696 - starting polling. Elapsed:0.003 Sep 30 10:00:46.731006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:00:46.732908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:696 - port information retrieved. Elapsed:0.007 Sep 30 10:00:46.733230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:696 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 10:00:48.727241 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:697 started Sep 30 10:00:48.729852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=229000000,duration_sec=1407,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:48.730612 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:48.731167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:697 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:00:50.727805 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:698 started Sep 30 10:00:50.730190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=230000000,duration_sec=1409,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:50.730771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:50.731117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:698 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:00:52.729227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:699 started Sep 30 10:00:52.731680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07b8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=231000000,duration_sec=1411,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:52.732242 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:52.732588 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:699 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:00:54.730579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:700 started Sep 30 10:00:54.732902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07ba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=233000000,duration_sec=1413,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:54.733458 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:54.733801 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:700 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:00:56.731832 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:701 started Sep 30 10:00:56.734498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=234000000,duration_sec=1415,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:56.735093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:56.735444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:701 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:00:58.732485 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:702 started Sep 30 10:00:58.734846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07be,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=235000000,duration_sec=1417,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:00:58.735409 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:00:58.735782 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:702 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:00.733051 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:703 started Sep 30 10:01:00.735356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07c0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=235000000,duration_sec=1419,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:00.735915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:00.736257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:703 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:02.733519 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:704 started Sep 30 10:01:02.735839 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07c2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=236000000,duration_sec=1421,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:02.736394 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:02.736739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:704 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:04.734861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:705 started Sep 30 10:01:04.737396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=237000000,duration_sec=1423,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:04.737959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:04.738309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:705 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:01:06.735500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:706 started Sep 30 10:01:06.738052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07c6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=238000000,duration_sec=1425,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:06.738643 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:06.738989 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:706 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:01:08.736760 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:707 started Sep 30 10:01:08.739100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=239000000,duration_sec=1427,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:08.739663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:08.740010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:707 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:10.737492 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:708 started Sep 30 10:01:10.739857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=240000000,duration_sec=1429,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:10.741344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:10.741344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:708 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:12.737912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:709 started Sep 30 10:01:12.740269 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=240000000,duration_sec=1431,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:12.740837 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:12.741187 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:709 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:14.739164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:710 started Sep 30 10:01:14.741467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=241000000,duration_sec=1433,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:14.742031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:14.742371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:710 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:16.740029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:711 started Sep 30 10:01:16.746250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=242000000,duration_sec=1435,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:16.746883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:16.747234 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:711 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 10:01:18.740622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:712 started Sep 30 10:01:18.743065 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=243000000,duration_sec=1437,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:18.743630 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:18.744016 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:712 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:01:20.741255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:713 started Sep 30 10:01:20.743570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=243000000,duration_sec=1439,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:20.744156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:20.744500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:713 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:22.742099 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:714 started Sep 30 10:01:22.744418 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=244000000,duration_sec=1441,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:22.744974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:22.745897 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:714 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:24.743408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:715 started Sep 30 10:01:24.746340 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=246000000,duration_sec=1443,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:24.746972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:24.747319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:715 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:01:26.744222 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:716 started Sep 30 10:01:26.747117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07da,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=247000000,duration_sec=1445,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:26.747682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:26.748031 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:716 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:01:28.745865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:717 started Sep 30 10:01:28.748195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=248000000,duration_sec=1447,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:28.748754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:28.749103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:717 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:30.746815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:718 started Sep 30 10:01:30.749174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07de,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=249000000,duration_sec=1449,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:30.749742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:30.750091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:718 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:32.747746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:719 started Sep 30 10:01:32.750049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07e0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=250000000,duration_sec=1451,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:32.750627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:32.750978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:719 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:34.748634 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:720 started Sep 30 10:01:34.750993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=251000000,duration_sec=1453,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:34.751558 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:34.751907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:720 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:36.750078 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:721 started Sep 30 10:01:36.752950 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=252000000,duration_sec=1455,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:36.753521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:36.753874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:721 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:01:38.751104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:722 started Sep 30 10:01:38.753419 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07e6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=253000000,duration_sec=1457,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:38.753975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:38.754317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:722 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:40.751748 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:723 started Sep 30 10:01:40.754384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07e8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=254000000,duration_sec=1459,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:40.754967 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:40.755342 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:723 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:01:42.752740 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:724 started Sep 30 10:01:42.755071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=255000000,duration_sec=1461,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:42.755628 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:42.755978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:724 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:01:44.753944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:725 started Sep 30 10:01:44.756395 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=256000000,duration_sec=1463,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:44.757237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:44.757590 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:725 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:01:46.754404 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:726 started Sep 30 10:01:46.757067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07ee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=257000000,duration_sec=1465,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:46.757635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:46.757986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:726 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:01:48.755037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:727 started Sep 30 10:01:48.757668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=257000000,duration_sec=1467,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:48.758228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:48.758572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:727 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:01:50.756294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:728 started Sep 30 10:01:50.758917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07f2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=259000000,duration_sec=1469,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:50.759483 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:50.759836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:728 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:01:51.661497 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b0663372-5378-425b-93f1-f4242b7f4e9f tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource Port deleted: 5a8a2d85-a9ed-4cda-a769-17f985851fae {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:01:51.661884 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b0663372-5378-425b-93f1-f4242b7f4e9f tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (5a8a2d85-a9ed-4cda-a769-17f985851fae), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:01:51.662299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b0663372-5378-425b-93f1-f4242b7f4e9f tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group member updated {'f2a6c367-7862-4ec6-9997-942326f64401'} Sep 30 10:01:52.757435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:729 started Sep 30 10:01:52.760137 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07f4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=260000000,duration_sec=1471,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:52.760699 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:52.761049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:729 - starting polling. Elapsed:0.004 Sep 30 10:01:52.763670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:01:52.764859 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 5a8a2d85-a9ed-4cda-a769-17f985851fae not present in bridge br-int Sep 30 10:01:52.765042 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 10:01:52.765332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['5a8a2d85-a9ed-4cda-a769-17f985851fae'] Sep 30 10:01:52.765677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 5a8a2d85-a9ed-4cda-a769-17f985851fae is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 10:01:52.767579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:729 - port information retrieved. Elapsed:0.010 Sep 30 10:01:52.767919 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:729 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.011 Sep 30 10:01:53.873631 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource SecurityGroup deleted: f2a6c367-7862-4ec6-9997-942326f64401 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:01:53.874201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (f2a6c367-7862-4ec6-9997-942326f64401), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:01:53.874500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f2a6c367-7862-4ec6-9997-942326f64401',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 10:01:53.889105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f2a6c367-7862-4ec6-9997-942326f64401',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 10:01:53.889518 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource SecurityGroupRule deleted: 7933048b-f33b-4407-90b5-833e44f9fd3b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:01:53.893037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (7933048b-f33b-4407-90b5-833e44f9fd3b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:01:53.893037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['f2a6c367-7862-4ec6-9997-942326f64401'] Sep 30 10:01:53.893037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource SecurityGroupRule deleted: db344460-73ef-4b7a-86bc-d60b87ab938f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:01:53.893037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (db344460-73ef-4b7a-86bc-d60b87ab938f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:01:53.893447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['f2a6c367-7862-4ec6-9997-942326f64401'] Sep 30 10:01:53.893447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource SecurityGroupRule deleted: 83b6ca8a-6973-49e3-9bbf-94281674b6e0 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:01:53.893447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (83b6ca8a-6973-49e3-9bbf-94281674b6e0), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:01:53.893447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['f2a6c367-7862-4ec6-9997-942326f64401'] Sep 30 10:01:53.893447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource SecurityGroupRule deleted: 28a29da7-33ff-471a-bf71-a971ef4116c5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:01:53.893895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (28a29da7-33ff-471a-bf71-a971ef4116c5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:01:53.893895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-8637f81f-b152-4669-9023-10df454ccd88 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Security group rule updated ['f2a6c367-7862-4ec6-9997-942326f64401'] Sep 30 10:01:54.332564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-35562635-11bf-4581-bda9-e513066cc395 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Resource Port deleted: 37bb6846-23f3-4ef8-86d2-87a1623f2047 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:01:54.332934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-35562635-11bf-4581-bda9-e513066cc395 tempest-AttachVolumeTestJSON-1314467243 tempest-AttachVolumeTestJSON-1314467243-project] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (37bb6846-23f3-4ef8-86d2-87a1623f2047), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:01:54.758345 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:730 started Sep 30 10:01:54.760684 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=261000000,duration_sec=1473,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:54.761258 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:54.761591 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:730 - starting polling. Elapsed:0.003 Sep 30 10:01:54.763139 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:01:54.764110 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 37bb6846-23f3-4ef8-86d2-87a1623f2047 not present in bridge br-int Sep 30 10:01:54.764438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] net_uuid None not managed by VLAN manager Sep 30 10:01:54.764721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for ['37bb6846-23f3-4ef8-86d2-87a1623f2047'] Sep 30 10:01:54.765064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.openvswitch_firewall.firewall [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port 37bb6846-23f3-4ef8-86d2-87a1623f2047 is not handled by the firewall. {{(pid=114230) remove_trusted_ports /opt/stack/neutron/neutron/agent/linux/openvswitch_firewall/firewall.py:873}} Sep 30 10:01:54.766764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:730 - port information retrieved. Elapsed:0.009 Sep 30 10:01:54.767132 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:730 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.009 Sep 30 10:01:56.759750 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:731 started Sep 30 10:01:56.762489 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07f8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=262000000,duration_sec=1475,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:56.763700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:56.764083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:731 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:01:58.760402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:732 started Sep 30 10:01:58.762905 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07fa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=263000000,duration_sec=1477,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:01:58.763572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:01:58.763980 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:732 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:01:59.096622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-3ac34ffd-6999-4579-a3cd-ba1367943a4d admin admin] Resource Port deleted: 54c4d0b4-c612-4724-9902-f7424400906b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:01:59.097012 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-3ac34ffd-6999-4579-a3cd-ba1367943a4d admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (54c4d0b4-c612-4724-9902-f7424400906b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:00.080354 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["5cfcf47a-45c5-4060-adac-e14526cb66be","delete","qr-54c4d0b4-c6",37,["map",[["attached-mac","fa:16:3e:fb:25:90"],["iface-id","54c4d0b4-c612-4724-9902-f7424400906b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 10:02:00.234478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-6f0f5049-99bc-4980-bf13-4839ef0d26d4 admin admin] Resource Port deleted: beeb0a48-a86c-43a4-9603-e4b77a8d536b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:00.234881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-6f0f5049-99bc-4980-bf13-4839ef0d26d4 admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (beeb0a48-a86c-43a4-9603-e4b77a8d536b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:00.477170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["44f4ce06-858c-4a00-b434-58aeb76a3fea","delete","qg-beeb0a48-a8",38,["map",[["attached-mac","fa:16:3e:26:9c:49"],["iface-id","beeb0a48-a86c-43a4-9603-e4b77a8d536b"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 10:02:00.761357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:733 started Sep 30 10:02:00.768984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c07fc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=269000000,duration_sec=1479,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:00.771621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:00.772069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:733 - starting polling. Elapsed:0.011 Sep 30 10:02:00.773377 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:00.777599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c07fe,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 37}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:00.783379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bbea3f72-406f-4725-a63d-3767f81fd0f7 admin admin] Resource Subnet deleted: cdfb3e22-5a9f-46a0-8aac-da19c4e3d178 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:00.784227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bbea3f72-406f-4725-a63d-3767f81fd0f7 admin admin] Publish callbacks [] for Subnet (cdfb3e22-5a9f-46a0-8aac-da19c4e3d178), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:00.786779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0800,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 38}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:00.793214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:733 - port information retrieved. Elapsed:0.029 Sep 30 10:02:00.793214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '476f0e98-0f2c-4e96-9e9d-e51e538823f1', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'54c4d0b4-c612-4724-9902-f7424400906b', 'beeb0a48-a86c-43a4-9603-e4b77a8d536b'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 10:02:00.793214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:733 - agent port security group processed in 0.000 Sep 30 10:02:00.793214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 10:02:00.793214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'54c4d0b4-c612-4724-9902-f7424400906b', 'beeb0a48-a86c-43a4-9603-e4b77a8d536b'} Sep 30 10:02:00.793957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 8 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 10:02:00.846457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[d156a7ae-e64c-4a23-9da2-b9609182d71b]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 10:02:00.847351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'54c4d0b4-c612-4724-9902-f7424400906b', 'beeb0a48-a86c-43a4-9603-e4b77a8d536b'} removed Sep 30 10:02:00.921114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 10:02:00.922293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:733 - treat_devices_removed completed in 0.130 Sep 30 10:02:00.922923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:733 - ports processed. Elapsed:0.162 Sep 30 10:02:00.923473 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:733 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 2}}. Elapsed:0.162 Sep 30 10:02:00.975593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.async_process [-] Output received from [ovsdb-client monitor tcp:127.0.0.1:6640 Interface name,ofport,external_ids --format=json]: {"data":[["6dff4e8c-c06e-4d5e-91cb-1e40f7140d49","delete","tap476f0e98-0f",36,["map",[["attached-mac","fa:16:3e:15:71:84"],["iface-id","476f0e98-0f2c-4e96-9e9d-e51e538823f1"],["iface-status","active"]]]]],"headings":["row","action","name","ofport","external_ids"]} {{(pid=114230) _read_stdout /opt/stack/neutron/neutron/agent/common/async_process.py:264}} Sep 30 10:02:01.173054 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0c5efe00-fb13-4b74-8b5c-e26ab84b804b admin admin] Resource Port deleted: 476f0e98-0f2c-4e96-9e9d-e51e538823f1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:01.174119 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0c5efe00-fb13-4b74-8b5c-e26ab84b804b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384', 'neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_member_delete-497271'] for Port (476f0e98-0f2c-4e96-9e9d-e51e538823f1), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:01.269715 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-80ccd548-100f-4bd8-98ba-d61c316fe64a None None] Resource Port deleted: 476f0e98-0f2c-4e96-9e9d-e51e538823f1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:01.270049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-80ccd548-100f-4bd8-98ba-d61c316fe64a None None] Skipped duplicate delete event for 476f0e98-0f2c-4e96-9e9d-e51e538823f1 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:212}} Sep 30 10:02:01.471770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-0c5efe00-fb13-4b74-8b5c-e26ab84b804b admin admin] Resource Network deleted: 6c765eee-bae8-4b34-897a-abb29acd5a27 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:01.472148 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-0c5efe00-fb13-4b74-8b5c-e26ab84b804b admin admin] Publish callbacks ['neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent.CacheBackedPluginApi._legacy_notifier-470384'] for Network (6c765eee-bae8-4b34-897a-abb29acd5a27), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:02.014093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Resource SecurityGroup deleted: cb235bf8-827b-4eff-b017-d7559402eaee {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:02.014471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (cb235bf8-827b-4eff-b017-d7559402eaee), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:02.014960 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('cb235bf8-827b-4eff-b017-d7559402eaee',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 10:02:02.034696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('cb235bf8-827b-4eff-b017-d7559402eaee',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 10:02:02.035093 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Resource SecurityGroupRule deleted: 08c9ecc2-21e6-4069-9cf8-129fa7e7ef52 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:02.035454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (08c9ecc2-21e6-4069-9cf8-129fa7e7ef52), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:02.035780 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Security group rule updated ['cb235bf8-827b-4eff-b017-d7559402eaee'] Sep 30 10:02:02.036370 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Resource SecurityGroupRule deleted: 42d83edc-2226-4a66-b747-8952b3160a5c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:02.036838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (42d83edc-2226-4a66-b747-8952b3160a5c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:02.037161 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Security group rule updated ['cb235bf8-827b-4eff-b017-d7559402eaee'] Sep 30 10:02:02.037532 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Resource SecurityGroupRule deleted: b167ffa5-4024-4f92-849b-cdc9d622d34c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:02.037867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (b167ffa5-4024-4f92-849b-cdc9d622d34c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:02.038212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Security group rule updated ['cb235bf8-827b-4eff-b017-d7559402eaee'] Sep 30 10:02:02.038572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Resource SecurityGroupRule deleted: e99b7954-c95e-4257-9b85-2187c1d9da56 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:02.038928 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e99b7954-c95e-4257-9b85-2187c1d9da56), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:02.039235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-944a9940-7883-4e5f-a5f2-ed36ca245e07 admin admin] Security group rule updated ['cb235bf8-827b-4eff-b017-d7559402eaee'] Sep 30 10:02:02.762541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:734 started Sep 30 10:02:02.765688 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0802,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=265000000,duration_sec=1481,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:02.766260 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:02.766700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:734 - starting polling. Elapsed:0.004 Sep 30 10:02:02.767963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Publish callbacks ['neutron.services.trunk.drivers.openvswitch.agent.ovsdb_handler.OVSDBHandler.process_trunk_port_events-330501'] for ovsdb (None), after_read {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:02.770762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x40,xid=0xf1c0804,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 36}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:02.771075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:734 - port information retrieved. Elapsed:0.009 Sep 30 10:02:02.771396 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Starting to process devices in:{'current': {'0a907ef6-0733-4f96-9909-bd47d7e38800', '452383da-1307-41b6-9960-d5a92f51b39f', '56479e13-743f-48e1-a33c-f8888b22c96a', '06250f14-1fc9-460b-b40b-16a566560978'}, 'added': set(), 'removed': {'476f0e98-0f2c-4e96-9e9d-e51e538823f1'}, 'updated': set(), 're_added': set()} {{(pid=114230) rpc_loop /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2787}} Sep 30 10:02:02.771717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:734 - agent port security group processed in 0.000 Sep 30 10:02:02.772720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Configuration for devices up [] and devices down [] completed. Sep 30 10:02:02.773029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Remove device filter for {'476f0e98-0f2c-4e96-9e9d-e51e538823f1'} Sep 30 10:02:02.773744 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.common.ovs_lib [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Processing 4 OpenFlow rules. {{(pid=114230) do_action_flows /opt/stack/neutron/neutron/agent/common/ovs_lib.py:562}} Sep 30 10:02:02.811891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG oslo.privsep.daemon [-] privsep: reply[7576e377-7f7b-4f2a-9f08-bf7fede45696]: (4, ('', '', 0)) {{(pid=115962) _call_back /usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py:501}} Sep 30 10:02:02.812474 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Ports {'476f0e98-0f2c-4e96-9e9d-e51e538823f1'} removed Sep 30 10:02:02.838246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Port removal failed for set() {{(pid=114230) treat_devices_removed /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py:2100}} Sep 30 10:02:02.838768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Reclaiming vlan = 14 from net-id = 6c765eee-bae8-4b34-897a-abb29acd5a27, seg-id = 389 Sep 30 10:02:02.841328 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xc9105f14,OFPFlowMod(buffer_id=4294967295,command=3,cookie=16864421859504038737,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 2, 'vlan_vid': 4110}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:02.843548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0xe,msg_len=0x48,xid=0xf1c0806,OFPFlowMod(buffer_id=4294967295,command=3,cookie=17454195956231332773,cookie_mask=18446744073709551615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],match=OFPMatch(oxm_fields={'in_port': 1, 'vlan_vid': 4485}),out_group=4294967295,out_port=4294967295,priority=0,table_id=255) result None {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:02.843865 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] process_network_ports - iteration:734 - treat_devices_removed completed in 0.071 Sep 30 10:02:02.844149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:734 - ports processed. Elapsed:0.082 Sep 30 10:02:02.844466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:734 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 1}}. Elapsed:0.082 Sep 30 10:02:04.067932 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T10:02:03Z,description='Default security group',id=b28a3721-3c70-4c63-8b4b-1781a0f3425a,is_default=True,name='default',project_id='079de817fc624bd4b00f344c664d951c',revision_number=1,rules=[SecurityGroupRule(3068ef46-eb9b-4cdc-beca-5d847980019e),SecurityGroupRule(8013cc4f-1b3f-412a-b451-2da722d6b373),SecurityGroupRule(bbe6860b-09de-4907-95c3-9ae48f95906d),SecurityGroupRule(e5cc4e2a-9111-4ec0-a89f-98363d757b8e)],shared=False,stateful=True,updated_at=2022-09-30T10:02:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:04.070030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (b28a3721-3c70-4c63-8b4b-1781a0f3425a), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:04.070030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:03Z,description=,direction='egress',ethertype='IPv4',id=3068ef46-eb9b-4cdc-beca-5d847980019e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='079de817fc624bd4b00f344c664d951c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b28a3721-3c70-4c63-8b4b-1781a0f3425a,updated_at=2022-09-30T10:02:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:04.070030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (3068ef46-eb9b-4cdc-beca-5d847980019e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:04.070030 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Security group rule updated ['b28a3721-3c70-4c63-8b4b-1781a0f3425a'] Sep 30 10:02:04.070449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:03Z,description=,direction='egress',ethertype='IPv6',id=8013cc4f-1b3f-412a-b451-2da722d6b373,normalized_cidr=None,port_range_max=,port_range_min=,project_id='079de817fc624bd4b00f344c664d951c',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b28a3721-3c70-4c63-8b4b-1781a0f3425a,updated_at=2022-09-30T10:02:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:04.070689 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8013cc4f-1b3f-412a-b451-2da722d6b373), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:04.070902 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Security group rule updated ['b28a3721-3c70-4c63-8b4b-1781a0f3425a'] Sep 30 10:02:04.071561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:03Z,description=,direction='ingress',ethertype='IPv6',id=bbe6860b-09de-4907-95c3-9ae48f95906d,normalized_cidr=None,port_range_max=,port_range_min=,project_id='079de817fc624bd4b00f344c664d951c',protocol=,remote_address_group_id=,remote_group_id=b28a3721-3c70-4c63-8b4b-1781a0f3425a,remote_ip_prefix=,revision_number=0,security_group_id=b28a3721-3c70-4c63-8b4b-1781a0f3425a,updated_at=2022-09-30T10:02:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:04.071907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (bbe6860b-09de-4907-95c3-9ae48f95906d), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:04.072228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Security group rule updated ['b28a3721-3c70-4c63-8b4b-1781a0f3425a'] Sep 30 10:02:04.072908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:03Z,description=,direction='ingress',ethertype='IPv4',id=e5cc4e2a-9111-4ec0-a89f-98363d757b8e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='079de817fc624bd4b00f344c664d951c',protocol=,remote_address_group_id=,remote_group_id=b28a3721-3c70-4c63-8b4b-1781a0f3425a,remote_ip_prefix=,revision_number=0,security_group_id=b28a3721-3c70-4c63-8b4b-1781a0f3425a,updated_at=2022-09-30T10:02:03Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:04.073254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e5cc4e2a-9111-4ec0-a89f-98363d757b8e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:04.073703 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-fa4a099f-d743-463c-a5aa-4c0f2ebf5cd8 admin admin] Security group rule updated ['b28a3721-3c70-4c63-8b4b-1781a0f3425a'] Sep 30 10:02:04.260995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Resource SecurityGroup deleted: b28a3721-3c70-4c63-8b4b-1781a0f3425a {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:04.261369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (b28a3721-3c70-4c63-8b4b-1781a0f3425a), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:04.261826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b28a3721-3c70-4c63-8b4b-1781a0f3425a',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 10:02:04.275033 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b28a3721-3c70-4c63-8b4b-1781a0f3425a',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 10:02:04.275430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Resource SecurityGroupRule deleted: 3068ef46-eb9b-4cdc-beca-5d847980019e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:04.275790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (3068ef46-eb9b-4cdc-beca-5d847980019e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:04.276117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Security group rule updated ['b28a3721-3c70-4c63-8b4b-1781a0f3425a'] Sep 30 10:02:04.276498 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Resource SecurityGroupRule deleted: 8013cc4f-1b3f-412a-b451-2da722d6b373 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:04.276842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8013cc4f-1b3f-412a-b451-2da722d6b373), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:04.277292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Security group rule updated ['b28a3721-3c70-4c63-8b4b-1781a0f3425a'] Sep 30 10:02:04.277996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Resource SecurityGroupRule deleted: bbe6860b-09de-4907-95c3-9ae48f95906d {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:04.278708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (bbe6860b-09de-4907-95c3-9ae48f95906d), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:04.282052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Security group rule updated ['b28a3721-3c70-4c63-8b4b-1781a0f3425a'] Sep 30 10:02:04.282052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Resource SecurityGroupRule deleted: e5cc4e2a-9111-4ec0-a89f-98363d757b8e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:04.282052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e5cc4e2a-9111-4ec0-a89f-98363d757b8e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:04.282052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5d031be7-401c-420f-bc4f-2de0abf6dd8a admin admin] Security group rule updated ['b28a3721-3c70-4c63-8b4b-1781a0f3425a'] Sep 30 10:02:04.763361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:735 started Sep 30 10:02:04.765817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0808,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=266000000,duration_sec=1483,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:04.766462 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:04.766903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:735 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:06.764121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:736 started Sep 30 10:02:06.766582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c080a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=266000000,duration_sec=1485,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:06.767197 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:06.767545 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:736 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:08.765413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:737 started Sep 30 10:02:08.767804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c080c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=268000000,duration_sec=1487,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:08.768369 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:08.768717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:737 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:02:09.765309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T10:02:09Z,description='Default security group',id=b638e7d0-4774-47bf-8f6a-dabe17eaaece,is_default=True,name='default',project_id='8e0743ef9beb45739ba705ffdce70162',revision_number=1,rules=[SecurityGroupRule(bc03e4d4-dd8c-46a1-a81d-9db6f18d3029),SecurityGroupRule(ca021dac-25a0-45ed-b809-1c5e3a06fb1c),SecurityGroupRule(d1094dc1-e73d-4d1c-a26a-b846fb899886),SecurityGroupRule(fb5ea830-b7ce-4cad-bd49-0c48d6f539b4)],shared=False,stateful=True,updated_at=2022-09-30T10:02:09Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:09.765682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (b638e7d0-4774-47bf-8f6a-dabe17eaaece), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:09.766300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:09Z,description=,direction='ingress',ethertype='IPv4',id=bc03e4d4-dd8c-46a1-a81d-9db6f18d3029,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e0743ef9beb45739ba705ffdce70162',protocol=,remote_address_group_id=,remote_group_id=b638e7d0-4774-47bf-8f6a-dabe17eaaece,remote_ip_prefix=,revision_number=0,security_group_id=b638e7d0-4774-47bf-8f6a-dabe17eaaece,updated_at=2022-09-30T10:02:09Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:09.766675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (bc03e4d4-dd8c-46a1-a81d-9db6f18d3029), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:09.767006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Security group rule updated ['b638e7d0-4774-47bf-8f6a-dabe17eaaece'] Sep 30 10:02:09.767754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:09Z,description=,direction='ingress',ethertype='IPv6',id=ca021dac-25a0-45ed-b809-1c5e3a06fb1c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e0743ef9beb45739ba705ffdce70162',protocol=,remote_address_group_id=,remote_group_id=b638e7d0-4774-47bf-8f6a-dabe17eaaece,remote_ip_prefix=,revision_number=0,security_group_id=b638e7d0-4774-47bf-8f6a-dabe17eaaece,updated_at=2022-09-30T10:02:09Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:09.768102 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (ca021dac-25a0-45ed-b809-1c5e3a06fb1c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:09.768449 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Security group rule updated ['b638e7d0-4774-47bf-8f6a-dabe17eaaece'] Sep 30 10:02:09.769100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:09Z,description=,direction='egress',ethertype='IPv4',id=d1094dc1-e73d-4d1c-a26a-b846fb899886,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e0743ef9beb45739ba705ffdce70162',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b638e7d0-4774-47bf-8f6a-dabe17eaaece,updated_at=2022-09-30T10:02:09Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:09.769465 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d1094dc1-e73d-4d1c-a26a-b846fb899886), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:09.769768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Security group rule updated ['b638e7d0-4774-47bf-8f6a-dabe17eaaece'] Sep 30 10:02:09.770413 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:09Z,description=,direction='egress',ethertype='IPv6',id=fb5ea830-b7ce-4cad-bd49-0c48d6f539b4,normalized_cidr=None,port_range_max=,port_range_min=,project_id='8e0743ef9beb45739ba705ffdce70162',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=b638e7d0-4774-47bf-8f6a-dabe17eaaece,updated_at=2022-09-30T10:02:09Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:09.770781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (fb5ea830-b7ce-4cad-bd49-0c48d6f539b4), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:09.771098 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-936bddd8-578e-4e5b-a8ce-c6b067910fa5 admin admin] Security group rule updated ['b638e7d0-4774-47bf-8f6a-dabe17eaaece'] Sep 30 10:02:09.978823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Resource SecurityGroup deleted: b638e7d0-4774-47bf-8f6a-dabe17eaaece {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:09.978975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (b638e7d0-4774-47bf-8f6a-dabe17eaaece), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:09.979398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('b638e7d0-4774-47bf-8f6a-dabe17eaaece',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 10:02:09.992934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('b638e7d0-4774-47bf-8f6a-dabe17eaaece',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 10:02:09.993303 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Resource SecurityGroupRule deleted: bc03e4d4-dd8c-46a1-a81d-9db6f18d3029 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:09.993669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (bc03e4d4-dd8c-46a1-a81d-9db6f18d3029), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:09.994006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Security group rule updated ['b638e7d0-4774-47bf-8f6a-dabe17eaaece'] Sep 30 10:02:09.994616 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Resource SecurityGroupRule deleted: ca021dac-25a0-45ed-b809-1c5e3a06fb1c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:09.995183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (ca021dac-25a0-45ed-b809-1c5e3a06fb1c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:09.995508 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Security group rule updated ['b638e7d0-4774-47bf-8f6a-dabe17eaaece'] Sep 30 10:02:09.995903 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Resource SecurityGroupRule deleted: d1094dc1-e73d-4d1c-a26a-b846fb899886 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:09.996298 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d1094dc1-e73d-4d1c-a26a-b846fb899886), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:09.996548 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Security group rule updated ['b638e7d0-4774-47bf-8f6a-dabe17eaaece'] Sep 30 10:02:09.997461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Resource SecurityGroupRule deleted: fb5ea830-b7ce-4cad-bd49-0c48d6f539b4 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:09.997777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (fb5ea830-b7ce-4cad-bd49-0c48d6f539b4), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:09.998277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b8d96883-18b9-49cb-8a7b-6b6c8a88508b admin admin] Security group rule updated ['b638e7d0-4774-47bf-8f6a-dabe17eaaece'] Sep 30 10:02:10.703621 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T10:02:10Z,description='Default security group',id=f58f014a-71ea-4a11-80e8-52db1c5ecd7b,is_default=True,name='default',project_id='ef63e4186cc34e35a5244d9efbc38bf0',revision_number=1,rules=[SecurityGroupRule(29a325c2-7486-46ef-8814-f24c7b6feb99),SecurityGroupRule(906f48b1-31c3-491f-9b29-b93a317588e9),SecurityGroupRule(c617d59d-6905-4719-97a9-a5cfd7e2bbab),SecurityGroupRule(fa34f920-072a-4e22-8ae7-39508114d2aa)],shared=False,stateful=True,updated_at=2022-09-30T10:02:10Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:10.704070 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (f58f014a-71ea-4a11-80e8-52db1c5ecd7b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:10.704772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:10Z,description=,direction='egress',ethertype='IPv6',id=29a325c2-7486-46ef-8814-f24c7b6feb99,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ef63e4186cc34e35a5244d9efbc38bf0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f58f014a-71ea-4a11-80e8-52db1c5ecd7b,updated_at=2022-09-30T10:02:10Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:10.705195 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (29a325c2-7486-46ef-8814-f24c7b6feb99), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:10.705599 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Security group rule updated ['f58f014a-71ea-4a11-80e8-52db1c5ecd7b'] Sep 30 10:02:10.706276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:10Z,description=,direction='egress',ethertype='IPv4',id=906f48b1-31c3-491f-9b29-b93a317588e9,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ef63e4186cc34e35a5244d9efbc38bf0',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f58f014a-71ea-4a11-80e8-52db1c5ecd7b,updated_at=2022-09-30T10:02:10Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:10.706650 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (906f48b1-31c3-491f-9b29-b93a317588e9), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:10.706979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Security group rule updated ['f58f014a-71ea-4a11-80e8-52db1c5ecd7b'] Sep 30 10:02:10.707659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:10Z,description=,direction='ingress',ethertype='IPv6',id=c617d59d-6905-4719-97a9-a5cfd7e2bbab,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ef63e4186cc34e35a5244d9efbc38bf0',protocol=,remote_address_group_id=,remote_group_id=f58f014a-71ea-4a11-80e8-52db1c5ecd7b,remote_ip_prefix=,revision_number=0,security_group_id=f58f014a-71ea-4a11-80e8-52db1c5ecd7b,updated_at=2022-09-30T10:02:10Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:10.708008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c617d59d-6905-4719-97a9-a5cfd7e2bbab), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:10.708405 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Security group rule updated ['f58f014a-71ea-4a11-80e8-52db1c5ecd7b'] Sep 30 10:02:10.709058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:10Z,description=,direction='ingress',ethertype='IPv4',id=fa34f920-072a-4e22-8ae7-39508114d2aa,normalized_cidr=None,port_range_max=,port_range_min=,project_id='ef63e4186cc34e35a5244d9efbc38bf0',protocol=,remote_address_group_id=,remote_group_id=f58f014a-71ea-4a11-80e8-52db1c5ecd7b,remote_ip_prefix=,revision_number=0,security_group_id=f58f014a-71ea-4a11-80e8-52db1c5ecd7b,updated_at=2022-09-30T10:02:10Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:10.709407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (fa34f920-072a-4e22-8ae7-39508114d2aa), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:10.709730 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-769c3697-9512-4027-bbaa-57033305231a admin admin] Security group rule updated ['f58f014a-71ea-4a11-80e8-52db1c5ecd7b'] Sep 30 10:02:10.766575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:738 started Sep 30 10:02:10.769075 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c080e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=269000000,duration_sec=1489,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:10.769641 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:10.770104 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:738 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:10.900049 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Resource SecurityGroup deleted: f58f014a-71ea-4a11-80e8-52db1c5ecd7b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:10.900238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (f58f014a-71ea-4a11-80e8-52db1c5ecd7b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:10.900592 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f58f014a-71ea-4a11-80e8-52db1c5ecd7b',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 10:02:10.914432 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f58f014a-71ea-4a11-80e8-52db1c5ecd7b',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 10:02:10.914921 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Resource SecurityGroupRule deleted: 29a325c2-7486-46ef-8814-f24c7b6feb99 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:10.915355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (29a325c2-7486-46ef-8814-f24c7b6feb99), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:10.915754 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Security group rule updated ['f58f014a-71ea-4a11-80e8-52db1c5ecd7b'] Sep 30 10:02:10.916202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Resource SecurityGroupRule deleted: 906f48b1-31c3-491f-9b29-b93a317588e9 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:10.916609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (906f48b1-31c3-491f-9b29-b93a317588e9), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:10.917058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Security group rule updated ['f58f014a-71ea-4a11-80e8-52db1c5ecd7b'] Sep 30 10:02:10.917427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Resource SecurityGroupRule deleted: c617d59d-6905-4719-97a9-a5cfd7e2bbab {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:10.917777 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c617d59d-6905-4719-97a9-a5cfd7e2bbab), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:10.918081 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Security group rule updated ['f58f014a-71ea-4a11-80e8-52db1c5ecd7b'] Sep 30 10:02:10.918442 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Resource SecurityGroupRule deleted: fa34f920-072a-4e22-8ae7-39508114d2aa {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:10.919352 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (fa34f920-072a-4e22-8ae7-39508114d2aa), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:10.919867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-59a3c0b2-339f-4e94-967a-2fefae67b752 admin admin] Security group rule updated ['f58f014a-71ea-4a11-80e8-52db1c5ecd7b'] Sep 30 10:02:12.767486 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:739 started Sep 30 10:02:12.773725 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0810,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=270000000,duration_sec=1491,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:12.774332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:12.774713 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:739 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 10:02:14.768188 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:740 started Sep 30 10:02:14.770555 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0812,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=270000000,duration_sec=1493,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:14.771163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:14.771512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:740 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:16.769567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:741 started Sep 30 10:02:16.772300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0814,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=272000000,duration_sec=1495,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:16.772874 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:16.773249 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:741 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:18.770786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:742 started Sep 30 10:02:18.773057 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0816,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=273000000,duration_sec=1497,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:18.773615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:18.773962 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:742 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:02:20.771775 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:743 started Sep 30 10:02:20.778076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0818,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=274000000,duration_sec=1499,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:20.778656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:20.779003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:743 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 10:02:21.817117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T10:02:21Z,description='Default security group',id=f7e9015b-cf16-4cce-8c2b-f25b8f2f2755,is_default=True,name='default',project_id='7eecfa8e79144860a3def88b9bccd3d2',revision_number=1,rules=[SecurityGroupRule(186a5805-3659-41fb-9c8f-7b7664c86422),SecurityGroupRule(c86648f6-344a-4f80-8f40-ababe4559e98),SecurityGroupRule(df9faab9-76e1-400d-ac0f-eb46b5cf2eae),SecurityGroupRule(ee741e42-a844-46cc-9da9-014eb503daff)],shared=False,stateful=True,updated_at=2022-09-30T10:02:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:21.818445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (f7e9015b-cf16-4cce-8c2b-f25b8f2f2755), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:21.818445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:21Z,description=,direction='egress',ethertype='IPv6',id=186a5805-3659-41fb-9c8f-7b7664c86422,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7eecfa8e79144860a3def88b9bccd3d2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f7e9015b-cf16-4cce-8c2b-f25b8f2f2755,updated_at=2022-09-30T10:02:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:21.818445 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (186a5805-3659-41fb-9c8f-7b7664c86422), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:21.818799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Security group rule updated ['f7e9015b-cf16-4cce-8c2b-f25b8f2f2755'] Sep 30 10:02:21.819468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:21Z,description=,direction='ingress',ethertype='IPv6',id=c86648f6-344a-4f80-8f40-ababe4559e98,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7eecfa8e79144860a3def88b9bccd3d2',protocol=,remote_address_group_id=,remote_group_id=f7e9015b-cf16-4cce-8c2b-f25b8f2f2755,remote_ip_prefix=,revision_number=0,security_group_id=f7e9015b-cf16-4cce-8c2b-f25b8f2f2755,updated_at=2022-09-30T10:02:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:21.819823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (c86648f6-344a-4f80-8f40-ababe4559e98), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:21.820143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Security group rule updated ['f7e9015b-cf16-4cce-8c2b-f25b8f2f2755'] Sep 30 10:02:21.820792 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:21Z,description=,direction='ingress',ethertype='IPv4',id=df9faab9-76e1-400d-ac0f-eb46b5cf2eae,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7eecfa8e79144860a3def88b9bccd3d2',protocol=,remote_address_group_id=,remote_group_id=f7e9015b-cf16-4cce-8c2b-f25b8f2f2755,remote_ip_prefix=,revision_number=0,security_group_id=f7e9015b-cf16-4cce-8c2b-f25b8f2f2755,updated_at=2022-09-30T10:02:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:21.821136 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (df9faab9-76e1-400d-ac0f-eb46b5cf2eae), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:21.821453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Security group rule updated ['f7e9015b-cf16-4cce-8c2b-f25b8f2f2755'] Sep 30 10:02:21.822095 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:21Z,description=,direction='egress',ethertype='IPv4',id=ee741e42-a844-46cc-9da9-014eb503daff,normalized_cidr=None,port_range_max=,port_range_min=,project_id='7eecfa8e79144860a3def88b9bccd3d2',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=f7e9015b-cf16-4cce-8c2b-f25b8f2f2755,updated_at=2022-09-30T10:02:21Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:21.822438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (ee741e42-a844-46cc-9da9-014eb503daff), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:21.822803 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-80cbda0c-87b1-4f36-ad7e-51e9c40cfc5d admin admin] Security group rule updated ['f7e9015b-cf16-4cce-8c2b-f25b8f2f2755'] Sep 30 10:02:22.019948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Resource SecurityGroup deleted: f7e9015b-cf16-4cce-8c2b-f25b8f2f2755 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:22.020286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (f7e9015b-cf16-4cce-8c2b-f25b8f2f2755), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.020742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('f7e9015b-cf16-4cce-8c2b-f25b8f2f2755',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 10:02:22.034130 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('f7e9015b-cf16-4cce-8c2b-f25b8f2f2755',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 10:02:22.034614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Resource SecurityGroupRule deleted: 186a5805-3659-41fb-9c8f-7b7664c86422 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:22.035061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (186a5805-3659-41fb-9c8f-7b7664c86422), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.035572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Security group rule updated ['f7e9015b-cf16-4cce-8c2b-f25b8f2f2755'] Sep 30 10:02:22.036018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Resource SecurityGroupRule deleted: c86648f6-344a-4f80-8f40-ababe4559e98 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:22.036705 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (c86648f6-344a-4f80-8f40-ababe4559e98), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.037105 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Security group rule updated ['f7e9015b-cf16-4cce-8c2b-f25b8f2f2755'] Sep 30 10:02:22.037538 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Resource SecurityGroupRule deleted: df9faab9-76e1-400d-ac0f-eb46b5cf2eae {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:22.037995 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (df9faab9-76e1-400d-ac0f-eb46b5cf2eae), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.038423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Security group rule updated ['f7e9015b-cf16-4cce-8c2b-f25b8f2f2755'] Sep 30 10:02:22.038952 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Resource SecurityGroupRule deleted: ee741e42-a844-46cc-9da9-014eb503daff {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:22.039357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (ee741e42-a844-46cc-9da9-014eb503daff), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.039737 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-75364615-4d7b-4578-a82a-ca20ef2f3a22 admin admin] Security group rule updated ['f7e9015b-cf16-4cce-8c2b-f25b8f2f2755'] Sep 30 10:02:22.765120 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T10:02:22Z,description='Default security group',id=0890b4f8-06ce-4ae8-948b-77afceb4c42f,is_default=True,name='default',project_id='562a7cabc2574abe8b59092a040ba0fd',revision_number=1,rules=[SecurityGroupRule(0d15380e-61cd-4d72-835e-2e18a2aa1eb7),SecurityGroupRule(1d1ed365-756a-41c7-9096-6fc2a8b13ed6),SecurityGroupRule(6bdd9591-ee05-4549-94a5-eb159b283fc5),SecurityGroupRule(e8859f3e-7455-45d1-ad9d-1ab3bb1467bc)],shared=False,stateful=True,updated_at=2022-09-30T10:02:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:22.765589 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (0890b4f8-06ce-4ae8-948b-77afceb4c42f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.766223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:22Z,description=,direction='ingress',ethertype='IPv4',id=0d15380e-61cd-4d72-835e-2e18a2aa1eb7,normalized_cidr=None,port_range_max=,port_range_min=,project_id='562a7cabc2574abe8b59092a040ba0fd',protocol=,remote_address_group_id=,remote_group_id=0890b4f8-06ce-4ae8-948b-77afceb4c42f,remote_ip_prefix=,revision_number=0,security_group_id=0890b4f8-06ce-4ae8-948b-77afceb4c42f,updated_at=2022-09-30T10:02:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:22.766582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (0d15380e-61cd-4d72-835e-2e18a2aa1eb7), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.766938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Security group rule updated ['0890b4f8-06ce-4ae8-948b-77afceb4c42f'] Sep 30 10:02:22.767618 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:22Z,description=,direction='ingress',ethertype='IPv6',id=1d1ed365-756a-41c7-9096-6fc2a8b13ed6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='562a7cabc2574abe8b59092a040ba0fd',protocol=,remote_address_group_id=,remote_group_id=0890b4f8-06ce-4ae8-948b-77afceb4c42f,remote_ip_prefix=,revision_number=0,security_group_id=0890b4f8-06ce-4ae8-948b-77afceb4c42f,updated_at=2022-09-30T10:02:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:22.767973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (1d1ed365-756a-41c7-9096-6fc2a8b13ed6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.768299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Security group rule updated ['0890b4f8-06ce-4ae8-948b-77afceb4c42f'] Sep 30 10:02:22.768979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:22Z,description=,direction='egress',ethertype='IPv6',id=6bdd9591-ee05-4549-94a5-eb159b283fc5,normalized_cidr=None,port_range_max=,port_range_min=,project_id='562a7cabc2574abe8b59092a040ba0fd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0890b4f8-06ce-4ae8-948b-77afceb4c42f,updated_at=2022-09-30T10:02:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:22.769332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (6bdd9591-ee05-4549-94a5-eb159b283fc5), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.769659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Security group rule updated ['0890b4f8-06ce-4ae8-948b-77afceb4c42f'] Sep 30 10:02:22.770317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:22Z,description=,direction='egress',ethertype='IPv4',id=e8859f3e-7455-45d1-ad9d-1ab3bb1467bc,normalized_cidr=None,port_range_max=,port_range_min=,project_id='562a7cabc2574abe8b59092a040ba0fd',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=0890b4f8-06ce-4ae8-948b-77afceb4c42f,updated_at=2022-09-30T10:02:22Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:22.770690 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e8859f3e-7455-45d1-ad9d-1ab3bb1467bc), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.771020 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-5470ab7f-c8ae-4f34-8380-3bdc72060400 admin admin] Security group rule updated ['0890b4f8-06ce-4ae8-948b-77afceb4c42f'] Sep 30 10:02:22.772978 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:744 started Sep 30 10:02:22.775651 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c081a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=276000000,duration_sec=1501,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:22.776216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:22.776562 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:744 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:22.944082 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Resource SecurityGroup deleted: 0890b4f8-06ce-4ae8-948b-77afceb4c42f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:22.944665 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (0890b4f8-06ce-4ae8-948b-77afceb4c42f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.944935 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('0890b4f8-06ce-4ae8-948b-77afceb4c42f',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 10:02:22.958793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('0890b4f8-06ce-4ae8-948b-77afceb4c42f',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 10:02:22.959265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Resource SecurityGroupRule deleted: 0d15380e-61cd-4d72-835e-2e18a2aa1eb7 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:22.959697 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (0d15380e-61cd-4d72-835e-2e18a2aa1eb7), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.960097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Security group rule updated ['0890b4f8-06ce-4ae8-948b-77afceb4c42f'] Sep 30 10:02:22.960495 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Resource SecurityGroupRule deleted: 1d1ed365-756a-41c7-9096-6fc2a8b13ed6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:22.960842 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (1d1ed365-756a-41c7-9096-6fc2a8b13ed6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.961190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Security group rule updated ['0890b4f8-06ce-4ae8-948b-77afceb4c42f'] Sep 30 10:02:22.961556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Resource SecurityGroupRule deleted: 6bdd9591-ee05-4549-94a5-eb159b283fc5 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:22.961899 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (6bdd9591-ee05-4549-94a5-eb159b283fc5), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.962238 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Security group rule updated ['0890b4f8-06ce-4ae8-948b-77afceb4c42f'] Sep 30 10:02:22.962619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Resource SecurityGroupRule deleted: e8859f3e-7455-45d1-ad9d-1ab3bb1467bc {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:22.962973 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e8859f3e-7455-45d1-ad9d-1ab3bb1467bc), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:22.963284 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-409e5027-7081-4ec7-aee5-d1522333c63d admin admin] Security group rule updated ['0890b4f8-06ce-4ae8-948b-77afceb4c42f'] Sep 30 10:02:23.715758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T10:02:23Z,description='Default security group',id=5c83c54c-ee64-42bc-9899-78da1671c09e,is_default=True,name='default',project_id='4c363685018e4809abd8c16a4e1372da',revision_number=1,rules=[SecurityGroupRule(37f94d5b-abaf-4bfc-9641-7e66e16f93f3),SecurityGroupRule(5737c168-4de7-4b33-879d-ecad906ae26b),SecurityGroupRule(d34643b8-e6b5-4e5d-8f91-31ab779f7865),SecurityGroupRule(e0ace861-c9d7-4635-912d-ae0dbd580d91)],shared=False,stateful=True,updated_at=2022-09-30T10:02:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:23.716135 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (5c83c54c-ee64-42bc-9899-78da1671c09e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:23.716798 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:23Z,description=,direction='ingress',ethertype='IPv6',id=37f94d5b-abaf-4bfc-9641-7e66e16f93f3,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4c363685018e4809abd8c16a4e1372da',protocol=,remote_address_group_id=,remote_group_id=5c83c54c-ee64-42bc-9899-78da1671c09e,remote_ip_prefix=,revision_number=0,security_group_id=5c83c54c-ee64-42bc-9899-78da1671c09e,updated_at=2022-09-30T10:02:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:23.717184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (37f94d5b-abaf-4bfc-9641-7e66e16f93f3), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:23.717524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Security group rule updated ['5c83c54c-ee64-42bc-9899-78da1671c09e'] Sep 30 10:02:23.718211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:23Z,description=,direction='egress',ethertype='IPv4',id=5737c168-4de7-4b33-879d-ecad906ae26b,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4c363685018e4809abd8c16a4e1372da',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5c83c54c-ee64-42bc-9899-78da1671c09e,updated_at=2022-09-30T10:02:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:23.718739 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5737c168-4de7-4b33-879d-ecad906ae26b), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:23.719071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Security group rule updated ['5c83c54c-ee64-42bc-9899-78da1671c09e'] Sep 30 10:02:23.719747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:23Z,description=,direction='ingress',ethertype='IPv4',id=d34643b8-e6b5-4e5d-8f91-31ab779f7865,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4c363685018e4809abd8c16a4e1372da',protocol=,remote_address_group_id=,remote_group_id=5c83c54c-ee64-42bc-9899-78da1671c09e,remote_ip_prefix=,revision_number=0,security_group_id=5c83c54c-ee64-42bc-9899-78da1671c09e,updated_at=2022-09-30T10:02:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:23.720088 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (d34643b8-e6b5-4e5d-8f91-31ab779f7865), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:23.720411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Security group rule updated ['5c83c54c-ee64-42bc-9899-78da1671c09e'] Sep 30 10:02:23.721066 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:23Z,description=,direction='egress',ethertype='IPv6',id=e0ace861-c9d7-4635-912d-ae0dbd580d91,normalized_cidr=None,port_range_max=,port_range_min=,project_id='4c363685018e4809abd8c16a4e1372da',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=5c83c54c-ee64-42bc-9899-78da1671c09e,updated_at=2022-09-30T10:02:23Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:23.721417 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (e0ace861-c9d7-4635-912d-ae0dbd580d91), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:23.721741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-bb36933f-a011-44c0-92b8-3dc081300332 admin admin] Security group rule updated ['5c83c54c-ee64-42bc-9899-78da1671c09e'] Sep 30 10:02:23.916360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Resource SecurityGroup deleted: 5c83c54c-ee64-42bc-9899-78da1671c09e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:23.916943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (5c83c54c-ee64-42bc-9899-78da1671c09e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:23.917657 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('5c83c54c-ee64-42bc-9899-78da1671c09e',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 10:02:23.932118 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('5c83c54c-ee64-42bc-9899-78da1671c09e',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 10:02:23.932594 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Resource SecurityGroupRule deleted: 37f94d5b-abaf-4bfc-9641-7e66e16f93f3 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:23.933041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (37f94d5b-abaf-4bfc-9641-7e66e16f93f3), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:23.933440 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Security group rule updated ['5c83c54c-ee64-42bc-9899-78da1671c09e'] Sep 30 10:02:23.933909 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Resource SecurityGroupRule deleted: 5737c168-4de7-4b33-879d-ecad906ae26b {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:23.934397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5737c168-4de7-4b33-879d-ecad906ae26b), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:23.935156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Security group rule updated ['5c83c54c-ee64-42bc-9899-78da1671c09e'] Sep 30 10:02:23.935595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Resource SecurityGroupRule deleted: d34643b8-e6b5-4e5d-8f91-31ab779f7865 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:23.935968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (d34643b8-e6b5-4e5d-8f91-31ab779f7865), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:23.936287 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Security group rule updated ['5c83c54c-ee64-42bc-9899-78da1671c09e'] Sep 30 10:02:23.936655 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Resource SecurityGroupRule deleted: e0ace861-c9d7-4635-912d-ae0dbd580d91 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:23.937000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (e0ace861-c9d7-4635-912d-ae0dbd580d91), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:23.937933 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b053c6dd-992d-452b-ad21-58c00a5865a0 admin admin] Security group rule updated ['5c83c54c-ee64-42bc-9899-78da1671c09e'] Sep 30 10:02:24.774443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:745 started Sep 30 10:02:24.780089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c081c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=277000000,duration_sec=1503,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:24.780670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:24.781027 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:745 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 10:02:26.775813 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:746 started Sep 30 10:02:26.778245 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c081e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=278000000,duration_sec=1505,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:26.778938 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:26.779216 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:746 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:28.776570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:747 started Sep 30 10:02:28.778881 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0820,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=279000000,duration_sec=1507,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:28.779593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:28.779968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:747 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:30.777864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:748 started Sep 30 10:02:30.780300 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0822,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=280000000,duration_sec=1509,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:30.780862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:30.781253 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:748 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:32.778892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:749 started Sep 30 10:02:32.785680 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0824,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=281000000,duration_sec=1511,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:32.786356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:32.786736 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:749 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 10:02:34.780212 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:750 started Sep 30 10:02:34.783021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0826,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=283000000,duration_sec=1513,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:34.783593 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:34.783941 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:750 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:36.782011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:751 started Sep 30 10:02:36.784374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0828,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=284000000,duration_sec=1515,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:36.784934 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:36.785291 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:751 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:02:38.782661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:752 started Sep 30 10:02:38.784971 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c082a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=285000000,duration_sec=1517,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:38.785531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:38.785879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:752 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:02:40.783482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:753 started Sep 30 10:02:40.785886 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c082c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=286000000,duration_sec=1519,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:40.786496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:40.786904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:753 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:42.784675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:754 started Sep 30 10:02:42.787058 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c082e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=287000000,duration_sec=1521,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:42.787608 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:42.787956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:754 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:02:44.785829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:755 started Sep 30 10:02:44.788186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0830,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=288000000,duration_sec=1523,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:44.788774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:44.789121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:755 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:02:46.786400 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:756 started Sep 30 10:02:46.789062 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0832,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=289000000,duration_sec=1525,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:46.789653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:46.789997 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:756 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:48.787357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:757 started Sep 30 10:02:48.789645 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0834,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=290000000,duration_sec=1527,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:48.790201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:48.790544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:757 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:50.787864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:758 started Sep 30 10:02:50.790389 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0836,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=290000000,duration_sec=1529,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:50.790972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:50.791314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:758 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:52.789246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:759 started Sep 30 10:02:52.791546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0838,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=291000000,duration_sec=1531,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:52.792121 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:52.792475 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:759 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:02:53.793454 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T10:02:53Z,description='Default security group',id=624588a7-de0c-4b35-ad14-601dab8171d6,is_default=True,name='default',project_id='52cdb6161cd54d0b9330532d7c6d4029',revision_number=1,rules=[SecurityGroupRule(868881d7-644a-4c55-9561-2943ce79cd74),SecurityGroupRule(8ef86b6a-dc21-4453-891c-5b883b29fdd6),SecurityGroupRule(933344ec-8ebf-477f-9e2c-4e20db17e79c),SecurityGroupRule(da6e46ed-abf3-4059-beba-a6196379b3f2)],shared=False,stateful=True,updated_at=2022-09-30T10:02:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:53.794515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (624588a7-de0c-4b35-ad14-601dab8171d6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:53.795164 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:53Z,description=,direction='egress',ethertype='IPv4',id=868881d7-644a-4c55-9561-2943ce79cd74,normalized_cidr=None,port_range_max=,port_range_min=,project_id='52cdb6161cd54d0b9330532d7c6d4029',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=624588a7-de0c-4b35-ad14-601dab8171d6,updated_at=2022-09-30T10:02:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:53.795524 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (868881d7-644a-4c55-9561-2943ce79cd74), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:53.795883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Security group rule updated ['624588a7-de0c-4b35-ad14-601dab8171d6'] Sep 30 10:02:53.796597 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:53Z,description=,direction='ingress',ethertype='IPv6',id=8ef86b6a-dc21-4453-891c-5b883b29fdd6,normalized_cidr=None,port_range_max=,port_range_min=,project_id='52cdb6161cd54d0b9330532d7c6d4029',protocol=,remote_address_group_id=,remote_group_id=624588a7-de0c-4b35-ad14-601dab8171d6,remote_ip_prefix=,revision_number=0,security_group_id=624588a7-de0c-4b35-ad14-601dab8171d6,updated_at=2022-09-30T10:02:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:53.796949 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (8ef86b6a-dc21-4453-891c-5b883b29fdd6), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:53.797326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Security group rule updated ['624588a7-de0c-4b35-ad14-601dab8171d6'] Sep 30 10:02:53.798002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:53Z,description=,direction='ingress',ethertype='IPv4',id=933344ec-8ebf-477f-9e2c-4e20db17e79c,normalized_cidr=None,port_range_max=,port_range_min=,project_id='52cdb6161cd54d0b9330532d7c6d4029',protocol=,remote_address_group_id=,remote_group_id=624588a7-de0c-4b35-ad14-601dab8171d6,remote_ip_prefix=,revision_number=0,security_group_id=624588a7-de0c-4b35-ad14-601dab8171d6,updated_at=2022-09-30T10:02:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:53.798375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (933344ec-8ebf-477f-9e2c-4e20db17e79c), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:53.798729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Security group rule updated ['624588a7-de0c-4b35-ad14-601dab8171d6'] Sep 30 10:02:53.799381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:02:53Z,description=,direction='egress',ethertype='IPv6',id=da6e46ed-abf3-4059-beba-a6196379b3f2,normalized_cidr=None,port_range_max=,port_range_min=,project_id='52cdb6161cd54d0b9330532d7c6d4029',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=624588a7-de0c-4b35-ad14-601dab8171d6,updated_at=2022-09-30T10:02:53Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:02:53.799741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (da6e46ed-abf3-4059-beba-a6196379b3f2), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:53.800052 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-b36de2f8-c7fa-48ce-9312-923f9d41c42f admin admin] Security group rule updated ['624588a7-de0c-4b35-ad14-601dab8171d6'] Sep 30 10:02:53.984446 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Resource SecurityGroup deleted: 624588a7-de0c-4b35-ad14-601dab8171d6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:53.984847 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (624588a7-de0c-4b35-ad14-601dab8171d6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:53.985306 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('624588a7-de0c-4b35-ad14-601dab8171d6',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 10:02:53.998112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('624588a7-de0c-4b35-ad14-601dab8171d6',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 10:02:53.998619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Resource SecurityGroupRule deleted: 868881d7-644a-4c55-9561-2943ce79cd74 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:53.999116 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (868881d7-644a-4c55-9561-2943ce79cd74), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:53.999561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Security group rule updated ['624588a7-de0c-4b35-ad14-601dab8171d6'] Sep 30 10:02:54.000067 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Resource SecurityGroupRule deleted: 8ef86b6a-dc21-4453-891c-5b883b29fdd6 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:54.000468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (8ef86b6a-dc21-4453-891c-5b883b29fdd6), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:54.000872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Security group rule updated ['624588a7-de0c-4b35-ad14-601dab8171d6'] Sep 30 10:02:54.001322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Resource SecurityGroupRule deleted: 933344ec-8ebf-477f-9e2c-4e20db17e79c {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:54.001734 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (933344ec-8ebf-477f-9e2c-4e20db17e79c), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:54.002114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Security group rule updated ['624588a7-de0c-4b35-ad14-601dab8171d6'] Sep 30 10:02:54.002682 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Resource SecurityGroupRule deleted: da6e46ed-abf3-4059-beba-a6196379b3f2 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:02:54.003056 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (da6e46ed-abf3-4059-beba-a6196379b3f2), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:02:54.003375 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-02f647f4-7c0e-4ab0-a11c-9c519d0db383 admin admin] Security group rule updated ['624588a7-de0c-4b35-ad14-601dab8171d6'] Sep 30 10:02:54.789831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:760 started Sep 30 10:02:54.792579 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c083a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=292000000,duration_sec=1533,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:54.795103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:54.795103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:760 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:56.790373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:761 started Sep 30 10:02:56.792981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c083c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=293000000,duration_sec=1535,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:56.793554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:56.793907 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:761 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:02:58.791294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:762 started Sep 30 10:02:58.793944 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c083e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=293000000,duration_sec=1537,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:02:58.794509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:02:58.794892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:762 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:03:00.792272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:763 started Sep 30 10:03:00.795126 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0840,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=294000000,duration_sec=1539,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:00.795437 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:00.795821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:763 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:03:02.792896 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:764 started Sep 30 10:03:02.795244 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0842,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=295000000,duration_sec=1541,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:02.795810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:02.796158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:764 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:04.793723 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:765 started Sep 30 10:03:04.796047 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0844,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=296000000,duration_sec=1543,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:04.796613 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:04.796958 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:765 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:06.794844 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:766 started Sep 30 10:03:06.797311 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0846,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=297000000,duration_sec=1545,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:06.797906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:06.798443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:766 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:03:07.282254 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Received new resource SecurityGroup: SecurityGroup(created_at=2022-09-30T10:03:07Z,description='Default security group',id=934efecd-d8a6-41c4-830c-c1525e6f76e2,is_default=True,name='default',project_id='6da128f02e0549a499923e6db6b5651d',revision_number=1,rules=[SecurityGroupRule(352357bd-2b01-40bf-91dd-5b3aac2a5896),SecurityGroupRule(41e455a2-71ed-49d5-ad70-a311882898c0),SecurityGroupRule(5fcf0cc8-f959-4ae5-973b-243bc7a5859e),SecurityGroupRule(6f140e47-d97e-47b9-938d-5e44afaf260f)],shared=False,stateful=True,updated_at=2022-09-30T10:03:07Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:03:07.282661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._add_child_sg_rules-497195'] for SecurityGroup (934efecd-d8a6-41c4-830c-c1525e6f76e2), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:03:07.283285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:03:07Z,description=,direction='egress',ethertype='IPv6',id=352357bd-2b01-40bf-91dd-5b3aac2a5896,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6da128f02e0549a499923e6db6b5651d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=934efecd-d8a6-41c4-830c-c1525e6f76e2,updated_at=2022-09-30T10:03:07Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:03:07.283646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (352357bd-2b01-40bf-91dd-5b3aac2a5896), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:03:07.283974 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Security group rule updated ['934efecd-d8a6-41c4-830c-c1525e6f76e2'] Sep 30 10:03:07.284649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:03:07Z,description=,direction='ingress',ethertype='IPv6',id=41e455a2-71ed-49d5-ad70-a311882898c0,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6da128f02e0549a499923e6db6b5651d',protocol=,remote_address_group_id=,remote_group_id=934efecd-d8a6-41c4-830c-c1525e6f76e2,remote_ip_prefix=,revision_number=0,security_group_id=934efecd-d8a6-41c4-830c-c1525e6f76e2,updated_at=2022-09-30T10:03:07Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:03:07.285003 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (41e455a2-71ed-49d5-ad70-a311882898c0), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:03:07.285327 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Security group rule updated ['934efecd-d8a6-41c4-830c-c1525e6f76e2'] Sep 30 10:03:07.285975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:03:07Z,description=,direction='egress',ethertype='IPv4',id=5fcf0cc8-f959-4ae5-973b-243bc7a5859e,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6da128f02e0549a499923e6db6b5651d',protocol=,remote_address_group_id=,remote_group_id=,remote_ip_prefix=,revision_number=0,security_group_id=934efecd-d8a6-41c4-830c-c1525e6f76e2,updated_at=2022-09-30T10:03:07Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:03:07.286326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (5fcf0cc8-f959-4ae5-973b-243bc7a5859e), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:03:07.286683 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Security group rule updated ['934efecd-d8a6-41c4-830c-c1525e6f76e2'] Sep 30 10:03:07.287341 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Received new resource SecurityGroupRule: SecurityGroupRule(created_at=2022-09-30T10:03:07Z,description=,direction='ingress',ethertype='IPv4',id=6f140e47-d97e-47b9-938d-5e44afaf260f,normalized_cidr=None,port_range_max=,port_range_min=,project_id='6da128f02e0549a499923e6db6b5651d',protocol=,remote_address_group_id=,remote_group_id=934efecd-d8a6-41c4-830c-c1525e6f76e2,remote_ip_prefix=,revision_number=0,security_group_id=934efecd-d8a6-41c4-830c-c1525e6f76e2,updated_at=2022-09-30T10:03:07Z) {{(pid=114230) record_resource_update /opt/stack/neutron/neutron/agent/resource_cache.py:195}} Sep 30 10:03:07.287698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_update-497166'] for SecurityGroupRule (6f140e47-d97e-47b9-938d-5e44afaf260f), after_update {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:03:07.288019 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-a856a7d1-d9f2-4a28-a359-899f31267453 admin admin] Security group rule updated ['934efecd-d8a6-41c4-830c-c1525e6f76e2'] Sep 30 10:03:07.434769 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Resource SecurityGroup deleted: 934efecd-d8a6-41c4-830c-c1525e6f76e2 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:03:07.435232 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._clear_child_sg_rules-497180'] for SecurityGroup (934efecd-d8a6-41c4-830c-c1525e6f76e2), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:03:07.435687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] neutron.api.rpc.handlers.resources_rpc.ResourcesPullRpcApi method bulk_pull called with arguments (, 'SecurityGroupRule') {'filter_kwargs': {'security_group_id': ('934efecd-d8a6-41c4-830c-c1525e6f76e2',)}} {{(pid=114230) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 30 10:03:07.449288 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] 0 resources returned for queries {('SecurityGroupRule', ('security_group_id', ('934efecd-d8a6-41c4-830c-c1525e6f76e2',)))} {{(pid=114230) _flood_cache_for_query /opt/stack/neutron/neutron/agent/resource_cache.py:91}} Sep 30 10:03:07.449696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Resource SecurityGroupRule deleted: 352357bd-2b01-40bf-91dd-5b3aac2a5896 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:03:07.450061 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (352357bd-2b01-40bf-91dd-5b3aac2a5896), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:03:07.450410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Security group rule updated ['934efecd-d8a6-41c4-830c-c1525e6f76e2'] Sep 30 10:03:07.450834 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Resource SecurityGroupRule deleted: 41e455a2-71ed-49d5-ad70-a311882898c0 {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:03:07.451177 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (41e455a2-71ed-49d5-ad70-a311882898c0), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:03:07.451496 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Security group rule updated ['934efecd-d8a6-41c4-830c-c1525e6f76e2'] Sep 30 10:03:07.451889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Resource SecurityGroupRule deleted: 5fcf0cc8-f959-4ae5-973b-243bc7a5859e {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:03:07.452181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (5fcf0cc8-f959-4ae5-973b-243bc7a5859e), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:03:07.452529 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Security group rule updated ['934efecd-d8a6-41c4-830c-c1525e6f76e2'] Sep 30 10:03:07.452853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.resource_cache [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Resource SecurityGroupRule deleted: 6f140e47-d97e-47b9-938d-5e44afaf260f {{(pid=114230) record_resource_delete /opt/stack/neutron/neutron/agent/resource_cache.py:208}} Sep 30 10:03:07.453199 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron_lib.callbacks.manager [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Publish callbacks ['neutron.api.rpc.handlers.securitygroups_rpc.SecurityGroupServerAPIShim._handle_sg_rule_delete-497157'] for SecurityGroupRule (6f140e47-d97e-47b9-938d-5e44afaf260f), after_delete {{(pid=114230) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Sep 30 10:03:07.453534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.agent.securitygroups_rpc [None req-50d88466-c727-41bc-bfda-0db8c3db0b54 admin admin] Security group rule updated ['934efecd-d8a6-41c4-830c-c1525e6f76e2'] Sep 30 10:03:08.795531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:767 started Sep 30 10:03:08.797868 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0848,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=298000000,duration_sec=1547,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:08.798447 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:08.798817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:767 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:10.796286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:768 started Sep 30 10:03:10.798644 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c084a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=298000000,duration_sec=1549,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:10.799201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:10.799547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:768 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:12.797158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:769 started Sep 30 10:03:12.799602 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c084c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=299000000,duration_sec=1551,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:12.803654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:12.803654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:769 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:03:14.797658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:770 started Sep 30 10:03:14.800005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c084e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=300000000,duration_sec=1553,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:14.800567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:14.800917 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:770 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:16.798632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:771 started Sep 30 10:03:16.801055 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0850,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=301000000,duration_sec=1555,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:16.801619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:16.801972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:771 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:03:18.799570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:772 started Sep 30 10:03:18.802076 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0852,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=302000000,duration_sec=1557,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:18.802677 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:18.803029 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:772 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:03:20.800365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:773 started Sep 30 10:03:20.802845 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0854,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=303000000,duration_sec=1559,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:20.803407 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:20.803758 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:773 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:03:22.801206 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:774 started Sep 30 10:03:22.803609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0856,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=303000000,duration_sec=1561,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:22.804173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:22.804523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:774 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:24.802115 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:775 started Sep 30 10:03:24.804521 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0858,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=304000000,duration_sec=1563,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:24.805091 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:24.805478 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:775 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:26.803171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:776 started Sep 30 10:03:26.807041 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c085a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=306000000,duration_sec=1565,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:26.807607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:26.807956 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:776 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 10:03:28.808636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:777 started Sep 30 10:03:28.810972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c085c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=311000000,duration_sec=1567,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:28.811534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:28.811882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:777 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 10:03:30.805673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:778 started Sep 30 10:03:30.808059 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c085e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=308000000,duration_sec=1569,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:30.808617 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:30.808963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:778 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:32.806544 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:779 started Sep 30 10:03:32.808936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0860,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=309000000,duration_sec=1571,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:32.809506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:32.809860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:779 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:34.807963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:780 started Sep 30 10:03:34.810243 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0862,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=310000000,duration_sec=1573,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:34.810826 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:34.811171 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:780 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:36.809309 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:781 started Sep 30 10:03:36.811772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0864,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=312000000,duration_sec=1575,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:36.812965 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:36.813325 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:781 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:03:38.810461 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:782 started Sep 30 10:03:38.812821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0866,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=313000000,duration_sec=1577,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:38.813379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:38.813729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:782 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:40.810963 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:783 started Sep 30 10:03:40.813666 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0868,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=314000000,duration_sec=1579,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:40.814235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:40.814604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:783 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:03:42.812235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:784 started Sep 30 10:03:42.814575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c086a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=314000000,duration_sec=1581,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:42.815167 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:42.815516 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:784 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:44.813316 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:785 started Sep 30 10:03:44.815870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c086c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=315000000,duration_sec=1583,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:44.816441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:44.816790 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:785 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:03:46.813843 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:786 started Sep 30 10:03:46.816181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c086e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=316000000,duration_sec=1585,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:46.816743 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:46.817089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:786 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:48.814574 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:787 started Sep 30 10:03:48.816959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0870,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=317000000,duration_sec=1587,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:48.817514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:48.817862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:787 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:50.815350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:788 started Sep 30 10:03:50.817659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0872,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=318000000,duration_sec=1589,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:50.818272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:50.818635 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:788 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:52.816270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:789 started Sep 30 10:03:52.818570 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0874,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=318000000,duration_sec=1591,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:52.819189 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:52.819535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:789 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:03:54.816972 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:790 started Sep 30 10:03:54.819285 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0876,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=319000000,duration_sec=1593,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:54.819870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:54.820214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:790 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:56.817379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:791 started Sep 30 10:03:56.819751 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0878,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=320000000,duration_sec=1595,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:56.820313 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:56.820669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:791 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:03:58.818023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:792 started Sep 30 10:03:58.820398 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c087a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=320000000,duration_sec=1597,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:03:58.821460 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:03:58.821836 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:792 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:00.819272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:793 started Sep 30 10:04:00.822477 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c087c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=322000000,duration_sec=1599,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:00.823074 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:00.823431 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:793 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:02.820357 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:794 started Sep 30 10:04:02.822706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c087e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=323000000,duration_sec=1601,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:02.823272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:02.823622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:794 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:04:04.821573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:795 started Sep 30 10:04:04.823954 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0880,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=324000000,duration_sec=1603,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:04.824523 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:04.824870 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:795 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:04:06.822948 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:796 started Sep 30 10:04:06.825305 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0882,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=325000000,duration_sec=1605,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:06.825906 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:06.826257 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:796 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:04:08.823411 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:797 started Sep 30 10:04:08.825729 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0884,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=326000000,duration_sec=1607,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:08.826286 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:08.826656 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:797 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:04:10.824421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:798 started Sep 30 10:04:10.826749 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0886,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=327000000,duration_sec=1609,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:10.827353 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:10.827700 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:798 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:12.825659 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:799 started Sep 30 10:04:12.828006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0888,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=328000000,duration_sec=1611,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:12.828567 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:12.828915 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:799 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:04:14.826293 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:800 started Sep 30 10:04:14.828957 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c088a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=329000000,duration_sec=1613,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:14.829527 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:14.829879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:800 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:16.826879 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:801 started Sep 30 10:04:16.829224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c088c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=329000000,duration_sec=1615,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:16.829784 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:16.830128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:801 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:04:18.827435 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:802 started Sep 30 10:04:18.829993 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c088e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=330000000,duration_sec=1617,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:18.830560 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:18.830943 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:802 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:20.828536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:803 started Sep 30 10:04:20.830976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0890,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=331000000,duration_sec=1619,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:20.831539 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:20.831887 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:803 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:22.829227 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:804 started Sep 30 10:04:22.831742 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0892,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=332000000,duration_sec=1621,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:22.832314 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:22.832669 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:804 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:24.830615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:805 started Sep 30 10:04:24.833302 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0894,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=333000000,duration_sec=1623,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:24.833867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:24.834220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:805 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:26.831096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:806 started Sep 30 10:04:26.833430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0896,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=333000000,duration_sec=1625,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:26.834344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:26.835215 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:806 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:28.832706 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:807 started Sep 30 10:04:28.835317 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0898,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=335000000,duration_sec=1627,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:28.836261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:28.836611 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:807 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:30.833975 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:808 started Sep 30 10:04:30.837261 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c089a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=337000000,duration_sec=1629,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:30.838200 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:30.838547 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:808 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 10:04:32.835180 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:809 started Sep 30 10:04:32.837626 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c089c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=337000000,duration_sec=1631,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:32.838193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:32.838573 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:809 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:34.836201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:810 started Sep 30 10:04:34.838536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c089e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=338000000,duration_sec=1633,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:34.839133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:34.839488 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:810 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:36.841500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:811 started Sep 30 10:04:36.844344 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08a0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=344000000,duration_sec=1635,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:36.844912 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:36.845266 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:811 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 10:04:38.838361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:812 started Sep 30 10:04:38.840717 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08a2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=341000000,duration_sec=1637,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:38.841277 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:38.841622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:812 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:04:40.838853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:813 started Sep 30 10:04:40.841208 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08a4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=341000000,duration_sec=1639,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:40.841771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:40.842122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:813 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:04:42.839686 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:814 started Sep 30 10:04:42.842023 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08a6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=342000000,duration_sec=1641,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:42.842585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:42.842955 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:814 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:04:44.840670 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:815 started Sep 30 10:04:44.843005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08a8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=343000000,duration_sec=1643,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:44.843564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:44.843910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:815 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:04:46.841356 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:816 started Sep 30 10:04:46.843708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08aa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=344000000,duration_sec=1645,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:46.844270 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:46.844619 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:816 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:04:48.842642 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:817 started Sep 30 10:04:48.845014 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08ac,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=345000000,duration_sec=1647,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:48.845582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:48.845942 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:817 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:04:50.843662 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:818 started Sep 30 10:04:50.845981 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08ae,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=346000000,duration_sec=1649,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:50.846541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:50.846914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:818 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:04:52.844127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:819 started Sep 30 10:04:52.846423 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08b0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=346000000,duration_sec=1651,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:52.847228 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:52.847582 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:819 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:54.845292 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:820 started Sep 30 10:04:54.847970 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08b2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=348000000,duration_sec=1653,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:54.848536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:54.848882 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:820 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:56.846883 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:821 started Sep 30 10:04:56.849259 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08b4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=349000000,duration_sec=1655,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:56.849830 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:56.850186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:821 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:04:58.847731 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:822 started Sep 30 10:04:58.850043 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08b6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=350000000,duration_sec=1657,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:04:58.850658 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:04:58.851010 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:822 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:00.849069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:823 started Sep 30 10:05:00.851410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08b8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=351000000,duration_sec=1659,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:00.851976 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:00.852361 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:823 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:02.850319 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:824 started Sep 30 10:05:02.852649 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08ba,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=353000000,duration_sec=1661,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:02.853235 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:02.853585 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:824 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:04.851441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:825 started Sep 30 10:05:04.853770 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08bc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=354000000,duration_sec=1663,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:04.854335 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:04.854716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:825 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:06.852759 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:826 started Sep 30 10:05:06.855147 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08be,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=355000000,duration_sec=1665,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:06.855747 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:06.856100 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:826 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:08.853648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:827 started Sep 30 10:05:08.856220 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08c0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=356000000,duration_sec=1667,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:08.856793 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:08.857151 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:827 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:05:10.854536 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:828 started Sep 30 10:05:10.856840 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08c2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=357000000,duration_sec=1669,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:10.857424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:10.857771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:828 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:12.855576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:829 started Sep 30 10:05:12.857821 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08c4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=358000000,duration_sec=1671,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:12.858386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:12.858767 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:829 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:14.856017 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:830 started Sep 30 10:05:14.858323 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08c6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=358000000,duration_sec=1673,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:14.858923 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:14.859276 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:830 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:16.856804 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:831 started Sep 30 10:05:16.859210 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08c8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=359000000,duration_sec=1675,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:16.859774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:16.860122 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:831 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:18.857468 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:832 started Sep 30 10:05:18.859862 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08ca,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=360000000,duration_sec=1677,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:18.860426 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:18.860779 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:832 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:05:20.858453 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:833 started Sep 30 10:05:20.860817 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08cc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=361000000,duration_sec=1679,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:20.861374 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:20.861720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:833 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:22.858936 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:834 started Sep 30 10:05:22.861163 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08ce,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=361000000,duration_sec=1681,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:22.861726 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:22.862079 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:834 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:24.859746 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:835 started Sep 30 10:05:24.862036 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08d0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=362000000,duration_sec=1683,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:24.862614 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:24.862968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:835 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:26.860494 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:836 started Sep 30 10:05:26.862846 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08d2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=363000000,duration_sec=1685,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:26.863408 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:26.863757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:836 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:28.861696 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:837 started Sep 30 10:05:28.864512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08d4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=364000000,duration_sec=1687,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:28.865089 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:28.865441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:837 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:05:30.874632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:838 started Sep 30 10:05:30.874632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08d6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=364000000,duration_sec=1689,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:30.874632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:30.874632 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:838 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:32.863414 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:839 started Sep 30 10:05:32.865822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08d8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=366000000,duration_sec=1691,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:32.867018 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:32.867607 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:839 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:05:34.864564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:840 started Sep 30 10:05:34.866924 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08da,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=367000000,duration_sec=1693,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:34.867509 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:34.867856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:840 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:36.866365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:841 started Sep 30 10:05:36.868873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08dc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=369000000,duration_sec=1695,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:36.869421 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:36.869771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:841 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:05:38.867155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:842 started Sep 30 10:05:38.869568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08de,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=369000000,duration_sec=1697,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:38.870133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:38.870480 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:842 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:05:40.868490 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:843 started Sep 30 10:05:40.870860 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08e0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=371000000,duration_sec=1699,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:40.871422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:40.871773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:843 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:42.869133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:844 started Sep 30 10:05:42.871546 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08e2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=371000000,duration_sec=1701,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:42.872106 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:42.872482 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:844 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:05:44.870439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:845 started Sep 30 10:05:44.872796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08e4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=373000000,duration_sec=1703,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:44.873360 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:44.873709 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:845 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:46.871466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:846 started Sep 30 10:05:46.873809 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08e6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=374000000,duration_sec=1705,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:46.874388 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:46.874786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:846 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:48.872084 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:847 started Sep 30 10:05:48.874422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08e8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=374000000,duration_sec=1707,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:48.875037 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:48.875386 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:847 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:50.872568 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:848 started Sep 30 10:05:50.874910 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08ea,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=375000000,duration_sec=1709,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:50.875476 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:50.875822 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:848 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:52.873861 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:849 started Sep 30 10:05:52.876239 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08ec,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=376000000,duration_sec=1711,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:52.876796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:52.877143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:849 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:05:54.875172 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:850 started Sep 30 10:05:54.877895 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08ee,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=378000000,duration_sec=1713,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:54.878457 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:54.878841 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:850 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:05:56.876439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:851 started Sep 30 10:05:56.879252 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08f0,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=379000000,duration_sec=1715,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:56.879763 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:56.880379 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:851 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:05:58.877595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:852 started Sep 30 10:05:58.881334 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08f2,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=380000000,duration_sec=1717,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:05:58.882256 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:05:58.882623 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:852 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 10:06:00.878615 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:853 started Sep 30 10:06:00.881205 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08f4,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=381000000,duration_sec=1719,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:00.881762 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:00.882131 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:853 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:02.994330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:854 started Sep 30 10:06:02.997653 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08f6,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=498000000,duration_sec=1721,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:02.998214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:02.998561 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:854 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:04.995087 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:855 started Sep 30 10:06:04.998068 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08f8,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=497000000,duration_sec=1723,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:04.999326 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:04.999674 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:855 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.005 Sep 30 10:06:06.996173 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:856 started Sep 30 10:06:06.998559 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08fa,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=498000000,duration_sec=1725,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:06.999543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:06.999891 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:856 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:08.996966 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:857 started Sep 30 10:06:08.999510 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08fc,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=499000000,duration_sec=1727,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:09.000077 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:09.000430 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:857 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:10.998373 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:858 started Sep 30 10:06:11.000773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c08fe,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=501000000,duration_sec=1729,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:11.001332 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:11.001716 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:858 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:06:12.998947 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:859 started Sep 30 10:06:13.001338 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0900,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=501000000,duration_sec=1731,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:13.001898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:13.002248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:859 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:06:14.999904 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:860 started Sep 30 10:06:15.002224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0902,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=502000000,duration_sec=1733,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:15.002815 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:15.003186 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:860 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:06:17.001174 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:861 started Sep 30 10:06:17.003535 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0904,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=503000000,duration_sec=1735,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:17.004113 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:17.004439 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:861 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:06:19.002605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:862 started Sep 30 10:06:19.005312 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0906,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=505000000,duration_sec=1737,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:19.005878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:19.006230 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:862 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:21.003636 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:863 started Sep 30 10:06:21.006648 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0908,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=506000000,duration_sec=1739,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:21.007211 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:21.007556 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:863 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:23.005176 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:864 started Sep 30 10:06:23.007606 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c090a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=507000000,duration_sec=1741,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:23.008170 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:23.008511 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:864 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:25.005787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:865 started Sep 30 10:06:25.008201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c090c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=508000000,duration_sec=1743,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:25.008799 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:25.009149 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:865 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:27.006528 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:866 started Sep 30 10:06:27.008864 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c090e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=509000000,duration_sec=1745,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:27.009427 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:27.009772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:866 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:06:29.007304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:867 started Sep 30 10:06:29.009629 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0910,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=510000000,duration_sec=1747,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:29.010181 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:29.010533 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:867 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:06:31.008168 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:868 started Sep 30 10:06:31.010566 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0912,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=510000000,duration_sec=1749,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:31.011155 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:31.011506 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:868 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:06:33.008781 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:869 started Sep 30 10:06:33.011198 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0914,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=511000000,duration_sec=1751,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:33.011764 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:33.012114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:869 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:35.009609 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:870 started Sep 30 10:06:35.011979 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0916,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=512000000,duration_sec=1753,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:35.012541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:35.012892 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:870 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:06:37.010531 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:871 started Sep 30 10:06:37.013158 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0918,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=513000000,duration_sec=1755,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:37.013720 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:37.014117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:871 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:39.011810 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:872 started Sep 30 10:06:39.014160 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c091a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=514000000,duration_sec=1757,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:39.014772 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:39.015124 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:872 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:06:41.012391 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:873 started Sep 30 10:06:41.015371 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c091c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=515000000,duration_sec=1759,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:41.016127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:41.016576 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:873 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:43.012852 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:874 started Sep 30 10:06:43.019156 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c091e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=515000000,duration_sec=1761,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:43.019721 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:43.020069 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:874 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.007 Sep 30 10:06:45.013424 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:875 started Sep 30 10:06:45.015757 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0920,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=516000000,duration_sec=1763,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:45.016322 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:45.016668 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:875 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:06:47.014064 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:876 started Sep 30 10:06:47.016443 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0922,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=516000000,duration_sec=1765,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:47.017005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:47.017351 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:876 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:06:49.014876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:877 started Sep 30 10:06:49.017203 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0924,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=517000000,duration_sec=1767,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:49.017761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:49.018103 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:877 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:06:51.016083 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:878 started Sep 30 10:06:51.019330 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0926,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=519000000,duration_sec=1769,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:51.019984 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:51.020401 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:878 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:53.016675 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:879 started Sep 30 10:06:53.018945 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0928,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=519000000,duration_sec=1771,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:53.019507 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:53.019850 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:879 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:06:55.017823 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:880 started Sep 30 10:06:55.020299 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c092a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=520000000,duration_sec=1773,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:55.020857 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:55.021201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:880 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:57.018500 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:881 started Sep 30 10:06:57.020876 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c092c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=521000000,duration_sec=1775,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:57.021530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:57.022381 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:881 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:06:59.019787 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:882 started Sep 30 10:06:59.022183 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c092e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=522000000,duration_sec=1777,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:06:59.022768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:06:59.023117 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:882 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:01.020867 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:883 started Sep 30 10:07:01.023856 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0930,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=524000000,duration_sec=1779,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:01.026343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:01.026343 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:883 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:03.022182 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:884 started Sep 30 10:07:03.051387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0932,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=524000000,duration_sec=1781,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:03.051387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:03.051387 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:884 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:05.022773 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:885 started Sep 30 10:07:05.025094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0934,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=525000000,duration_sec=1783,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:05.025652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:05.025996 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:885 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:07.023209 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:886 started Sep 30 10:07:07.025530 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0936,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=525000000,duration_sec=1785,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:07.026096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:07.026438 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:886 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:09.024201 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:887 started Sep 30 10:07:09.026761 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0938,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=526000000,duration_sec=1787,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:09.027350 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:09.027698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:887 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:11.025138 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:888 started Sep 30 10:07:11.027831 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c093a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=528000000,duration_sec=1789,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:11.028422 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:11.028771 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:888 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:13.026272 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:889 started Sep 30 10:07:13.028873 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c093c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=528000000,duration_sec=1791,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:13.029467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:13.029806 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:889 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:15.027086 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:890 started Sep 30 10:07:15.029661 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c093e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=529000000,duration_sec=1793,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:15.030255 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:15.030627 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:890 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:17.027687 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:891 started Sep 30 10:07:17.029959 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0940,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=530000000,duration_sec=1795,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:17.030514 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:17.030889 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:891 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:19.029096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:892 started Sep 30 10:07:19.031467 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0942,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=531000000,duration_sec=1797,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:19.032022 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:19.032365 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:892 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:21.029878 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:893 started Sep 30 10:07:21.032265 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0944,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=532000000,duration_sec=1799,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:21.032827 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:21.033184 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:893 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:23.030382 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:894 started Sep 30 10:07:23.032673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0946,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=533000000,duration_sec=1801,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:23.033246 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:23.033601 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:894 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:25.031224 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:895 started Sep 30 10:07:25.035990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0948,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=534000000,duration_sec=1803,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:25.035990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:25.035990 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:895 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:27.032564 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:896 started Sep 30 10:07:27.034914 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c094a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=535000000,duration_sec=1805,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:27.035479 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:27.035829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:896 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:29.033986 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:897 started Sep 30 10:07:29.036333 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c094c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=536000000,duration_sec=1807,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:29.036893 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:29.037236 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:897 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:31.034853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:898 started Sep 30 10:07:31.037304 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c094e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=537000000,duration_sec=1809,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:31.046233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:31.046233 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:898 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:33.035541 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:899 started Sep 30 10:07:33.038094 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0950,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=538000000,duration_sec=1811,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:33.038691 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:33.039652 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:899 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:35.037025 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:900 started Sep 30 10:07:35.039448 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0952,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=539000000,duration_sec=1813,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:35.040008 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:35.040355 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:900 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:37.037774 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:901 started Sep 30 10:07:37.040638 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0954,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=540000000,duration_sec=1815,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:37.041202 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:37.041553 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:901 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:39.039512 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:902 started Sep 30 10:07:39.041853 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0956,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=542000000,duration_sec=1817,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:39.042410 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:39.042786 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:902 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:41.040190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:903 started Sep 30 10:07:41.042622 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0958,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=542000000,duration_sec=1819,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:41.043190 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:41.043575 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:903 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:43.041127 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:904 started Sep 30 10:07:43.043466 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c095a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=543000000,duration_sec=1821,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:43.044032 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:43.044384 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:904 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:45.042543 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:905 started Sep 30 10:07:45.044999 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c095c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=545000000,duration_sec=1823,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:45.045554 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:45.045908 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:905 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:47.043838 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:906 started Sep 30 10:07:47.046223 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c095e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=546000000,duration_sec=1825,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:47.046814 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:47.047165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:906 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:49.044534 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:907 started Sep 30 10:07:49.047002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0960,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=547000000,duration_sec=1827,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:49.047595 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:49.047968 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:907 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:51.045469 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:908 started Sep 30 10:07:51.052021 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0962,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=548000000,duration_sec=1829,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:51.052586 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:51.052937 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:908 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.008 Sep 30 10:07:53.046294 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:909 started Sep 30 10:07:53.048572 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0964,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=548000000,duration_sec=1831,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:53.049128 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:53.049471 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:909 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:55.046829 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:910 started Sep 30 10:07:55.049402 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0966,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=549000000,duration_sec=1833,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:55.050112 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:55.050464 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:910 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:07:57.047796 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:911 started Sep 30 10:07:57.050143 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0968,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=550000000,duration_sec=1835,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:57.050741 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:57.051096 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:911 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:07:59.048698 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:912 started Sep 30 10:07:59.051085 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c096a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=551000000,duration_sec=1837,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:07:59.051654 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:07:59.052005 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:912 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:08:01.049499 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:913 started Sep 30 10:08:01.051880 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c096c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=552000000,duration_sec=1839,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:08:01.052463 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:08:01.052807 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:913 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:08:03.050071 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:914 started Sep 30 10:08:03.052600 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c096e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=552000000,duration_sec=1841,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:08:03.053165 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:08:03.053515 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:914 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:08:05.050885 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:915 started Sep 30 10:08:05.053237 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0970,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=553000000,duration_sec=1843,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:08:05.053802 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:08:05.054152 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:915 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:08:07.051397 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:916 started Sep 30 10:08:07.053708 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0972,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=554000000,duration_sec=1845,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:08:07.054901 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:08:07.055250 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:916 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:08:09.052133 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:917 started Sep 30 10:08:09.054444 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0974,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=554000000,duration_sec=1847,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:08:09.055053 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:08:09.055403 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:917 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:08:11.053002 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:918 started Sep 30 10:08:11.055441 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0976,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=555000000,duration_sec=1849,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:08:11.056006 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:08:11.056362 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:918 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:08:13.053639 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:919 started Sep 30 10:08:13.056114 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0978,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=556000000,duration_sec=1851,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:08:13.056685 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:08:13.057039 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:919 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:08:15.054549 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:920 started Sep 30 10:08:15.057097 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c097a,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=557000000,duration_sec=1853,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:08:15.057663 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:08:15.058011 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:920 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:08:17.055673 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:921 started Sep 30 10:08:17.058024 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c097c,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=558000000,duration_sec=1855,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:08:17.058605 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:08:17.059000 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:921 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.003 Sep 30 10:08:19.056646 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:922 started Sep 30 10:08:19.059308 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c097e,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=559000000,duration_sec=1857,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:08:19.059872 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:08:19.060248 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:922 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:08:21.057768 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:923 started Sep 30 10:08:21.060214 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0980,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=560000000,duration_sec=1859,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:08:21.060789 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:08:21.061144 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:923 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004 Sep 30 10:08:23.058898 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:924 started Sep 30 10:08:23.061604 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ofswitch [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] ofctl request version=0x4,msg_type=0x12,msg_len=0x38,xid=0xf1c0982,OFPFlowStatsRequest(cookie=0,cookie_mask=0,flags=0,match=OFPMatch(oxm_fields={}),out_group=4294967295,out_port=4294967295,table_id=23,type=1) result [OFPFlowStatsReply(body=[OFPFlowStats(byte_count=0,cookie=17454195956231332773,duration_nsec=561000000,duration_sec=1861,flags=0,hard_timeout=0,idle_timeout=0,instructions=[],length=56,match=OFPMatch(oxm_fields={}),packet_count=0,priority=0,table_id=23)],flags=0,type=1)] {{(pid=114230) _send_msg /opt/stack/neutron/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ofswitch.py:124}} Sep 30 10:08:23.062193 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: DEBUG neutron.agent.linux.utils [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Found cmdline ['ovsdb-client', 'monitor', 'tcp:127.0.0.1:6640', 'Interface', 'name,ofport,external_ids', '--format=json'] for process with PID 116025. {{(pid=114230) get_cmdline_from_pid /opt/stack/neutron/neutron/agent/linux/utils.py:334}} Sep 30 10:08:23.062542 dv-cinder-master-3-iscsi neutron-openvswitch-agent[114230]: INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [None req-9156a9d4-48f8-4648-9cb0-c2b9f924cc39 None None] Agent rpc_loop - iteration:924 completed. Processed ports statistics: {'regular': {'added': 0, 'updated': 0, 'removed': 0}}. Elapsed:0.004